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In  support  of  a  theory  for  manual  control  displays,  and,  in  particular,  for 
integrated  displays,  a  series  of  tvo  pilot  experiments  were  performed  to  enlarge 
the  data  base  for  the  theory.  A  single-axis  tracWLng  experiment  was  performed 
with  tvo  different  controlled  elements  and  four  different  display  formats .  The 
effects  of  display  format  were  separately  evaluated  from  task  difficulty  and  task 
performance  with  a  particular  view  toward  quantification  of  the  pilots'  parafoveal 
perceptual  ability.  In  the  second  experiment  four  different  integrated  displays 
were  tested  in  a  precision  tracking  task  with  a  view  toward  quantifying  the  effect 
of  integration  in  the  display.  Different  forms  of  integration  of  the  display  were 
found  to  strongly  influence  the  pilots'  excess  control  capacity  which  is  the  comple¬ 
ment  of  workload.  Describing  functions,  remnant,  eye -movements,  and  pilot  opinion 
data  were  also  recorded  in  theaef  experiments.  Interpretation  and  the  conclusions 
to  be  drawn  from  all  these  data/are  presented  in  the  report. 
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FOREWORD 


This  report  presents  vcrk  vhich  vas  performed  under  the  Joint  Army 
Ha vy  Aircraft  Instrumentation  Research  (JAHAIR)  Prcgren,  a  research  and 
exploratory  development  program  directed  by  the  United  States  fiavy, 

Office  of  Havai  Research.  Special  guidance  is  provided  to  the  program 
for  the  Amy  Electronics  Command  -  the  Havai  Air  Systecs  G errand ,  and  the 
Office  of  Havai  Research  throu.it.  an  organisation  knovn  as  the  JAHAIR 
Working  Group.  The  Wcikisr.  'roup  is  currently  composed  of  representa¬ 
tives  from  the  f cllcvi.ru;  offices: 

U.  ?  Ha vy,  1-ffice  of  Havai  Research,  Aeronaut! ;s,  Code  16’ 

^-uiington,  D.  C. 

-  Aircraft  Instrumentation  and  Control  Program  Area 

U.  S.  Eavy,  Havai  Air  Systems  Command,  Washington,  B.  C. 

-  Avionics  Division,  navigation  Instrumentation  ana  Display 
Branch  (SAVAIR  5557) 

-  Crev  Systems  Division,  Cockpit/Cebin  Requirements  and 
Standards  Branch  (itAYAIK  55' 5) 

U.  S.  Airy,  Amy  Electronics  Command,  Avionics  Laboratory, 

Fort  Monmouth,  Eev  Jersey 

-  Instrumentation  Technical  Area  ' AH3EL-YI  I) 

Tne  Joint  A.rmy  Kavy  Aircraft  Instrumentation  Research  Program  objective 
is:  To  conduct  applied  research  using  analytical  and  experimental  investi¬ 
gations  for  identifying,  defining  and  validating  advanced  concepts  vhi'n 
may  be  applied  to  future,  improved  Havai  and  Army  aircraft  instrumentation 
systems.  This  includes  sensing  elements,  data  piccesscrs,  displays,  controls 
and  man/machine  Interfaces  for  fixed  and  rotary  ving  aircraft  for  all  flight 
regimes. 


_ .  *o 
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ABSTRACT 


In  support  of  a  theory  for  manual  control  displays,  and,  in  particular, 
for  integrated  displays,  a  series  of  tvc  pilot  experiments  were  performed  to 
enlarge  the  data  base  for  the  theory.  A  single-axis  tracking  experiment  vas 
performed  with  two  different  controlled  elements  and  four  different  display 
formats.  The  effects  of  display  format  were  separately  evaluate*'  from  task 
difficulty  and  task  performance  with  a  particular  view  toward  quantification 
of  the  pilots’  parafoveal  perce- ‘‘ual  ability.  In  the  second  experiment 
four  different  integrated  displays  were  teoted  in  a  precision  tracking  task 
with  a  view  toward  quantifying  the  effect  of  integration  in  the  display. 
Different  forms  of  integration  of  the  display  were  found  to  strongly  influ¬ 
ence  the  pilots'  excess  control  capacity  which  is  the  complement  of  workload 
Describing  functions,  remnant,  eye -movements,  e&.  pilot  op'nict  data  were 
also  recorded  in  these  experiments.  Interpretation  and  .he  conclusions  to 
be  drawn  frer  all  these  data  are  presented  in  the  report. 
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Displayed  error  of  item  a  among  several  displayed 
quantities 


AFCS  Automatic  Flight  Control  System 

ATT  Attitude  display 

"til 

A.,  Amplitude  of  the  i  sinusoidal  component  in  the 

quasi-random  command  velocity  input 

b^  Displayed  error  of  item  b  amoDg  several  displayed 

quantities 


B1  Longitudinal  cyclic  pitching  moment  control  displace 

ment  in  rad  (see  also  6^,  5g) 

c  Pilot's  control  action 

c  Pilot’ 8  control  action  in  response  to  displayed 

error  of  item  a 


Pilot's  control  action  in  response  to  displayed 
error  of  item  b 


CRT 
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DFA 
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eff 


Cathode  Ray  Tube 

Laplace  transform  of  control  displacement 
Glide  slope  displacement  guidance  beam  command 

Director  display  format  without  any  confidence - 
inspiring  situation  information 

Describing  function 

Describing  function  analyzer 

Displayed  error  signal;  also  Naperian  base  2.71828.. 

Mean-squared  error  or  time  variance  of  error 

Square  of  the  mean  error  or  square  of  the  time- 
avereged  error 

Error  criterion 
Displayed  error 

Kf feetl ve  v alue 
:<H  ! 


1 

I,  1(b) 

IAS 

IE 

IE2 

IFR 

ILS 

Ira 

IV3I 

b 

3 


Eye -Point -of -Regard 

Scanned  and  sampled  (displayed)  error 

Laplace  transform  of  displayed  error  signal 
Flight  Director 

Mean  fixation  (scanning)  frequency  in  Hz. 

Mean  fixation  frequency  on  the  displayed  airspeed 
signal 

Gravitational  acceleration 
Glide  Slope  Deviation  display 
Altitude 

Vertical  velocity 
Altitude  error 

Horizontal  Situation  Indicator 

Abbreviation  for  Hertz,  a  unit  of  frequency  measure 
equivalent  to  one  cycle  per  sec. 

Command  input  signal  or  forcing  function  symbol; 
summation  index 

Laplace  transform  of  command  input 

Indicated  Air  Speed 

Time  integral  of  error 

Time  integral  of  error-squared 

Instrument  Flight  Rules 

Instrument  Landing  System 

Imaginary  part  of  ... 

Instantaneous  Vertical  Speed  Indicator 

Pitching  moment  of  inertia  of  controlled  element 
in  slug-fi,8 

*f- T  j  summation  index 
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Operational  arguaest  of  the  Fourier  transform; 
also  imaginary  part  of  the  complex  argument  of 
the  Laplace  traD3fc.ro 

Summation  index 

Gain  of  a  transfer  function  or  of  a  describing 
function 

Controlled  element  gain  in  the  roll  axis 

Controlled  element  gain  in  the  collective  axis 

Velocity  controlled  element  transfer  function; 
an  integrator  of  control  input  with  gain  K 

Acceleration  controlled  element  transfer  function; 
a  double  integrator  of  control  input  with  gain  K 

Pilot's  foveal  describing  function  gain 

Pilot’s  perceptual  gain  or  ctcenuation  factor 

Pilot's  gain  in  response  to  motion  cues,  used 
for  lead  equalization  ~ 

Pilot's  adaptive  gain  in  general;  parafovea'.  gain 

Pilot's  compensatory  gain 

Pilot's  gain  in  response  to  the  displayed 
longitudinal  error  signal 

Longitudinal  cyclic  pitch  control  stick  gain 

Pilot's  or  flight  director  gain  in  response  to 
pitch  attitude  deviations  from  trimmed  attitude 

Pilot's  gain  in  response  ho  roll  attitude  deviations 
from  trimmed  attitude 

Controlled  element  state  variables  or  output 
motion  signals;  mass  of  the  helicopter  in  slugs 

Pitching  moment  applied  to  controlled  element; 

integer  1 

LapTace  transform  of  controlled  element  motion 
(l/ly)(dM/5B1)  in  see"" 


M 

q 

( l/lyHity/dq,)  in  sec"' 

M 

s 

Scanning  workload  margin 

\ 

O/^Hd^du)  in  f^sec’^ 

na 

Equivalent  "observation"  remnant  associated  with 
displayed  error  of  item  a 

"b 

Equivalent  "observation"  remnant  associated  with 
displayed  error  of  item  b 

n 

c 

Pilot's  remnant  associated  with  control  action,  c 

°P 

"Processing"  remnant,  i.e.,  nortion  of  nllot's 
remnant  dependent  on  error  level 

n 

r 

Constant  residual  level  of  pilot's  remnant 

ns 

"Scanning"  remnant,  a  special  type  of  processing 
remnant,  np 

N 

Integer 

Pc 

Crossover  period,  2rt/o>c,  in  sec 

q 

Pitching  angular  velocity  in  rad/sec 

Vqji 

Fixation  transition  probabilities  (lia’;  values) 
in  the  direction  i  -*  J  and  J  •*  i,  respectively  j 
i  f  J 

R 

Pilot's  perceptual  rate  weighting  coefficient 

Rc  •  •  • 

Real  part  of  ... 

rraa,  RM3 

Root -Me an -Squared  value 

9 

Complex  argument  of  the  Laplace  transform 

8 

"State"  display  format  without  rate  (no  longitudinal 
error  rate  syribol);  also  a  dimensionless  scanning 
frequency  ratio,  ufc/a\,(l  -  If)  -  P,  /T^ 

8 

W 

81gnal-to-noiae  power  ratio 

3  +  R 

"State  and  Rate"  display  format  (longitudinal 
error  rate  symbol  added  to  8) 
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xvi 

Time 


Eye  fixation  dwell  interval  in  sec 

Mean  value  of  fixation  dwell  interval  in  sec 

Mean  fixation  dwell  interval  on  cathode  ray 
tube  display 

Effective  display  lag  time  constant  in  sec 

Human  operator's  effective  internal  dwell 
interval  given  by  product  qeT8 

Effective  average  dwell  interval  in  sec 

Mean  fixation  dwell  interval  on  altitude  and 
vertical  speed  displays 

Lag  equalization  time  constant  in  sec 

Lead  equalization  time  constant  in  sec 

Value  of  adopted  for  longitudinal  (x-)  position 
regulation  in  sec 

Effective  neuromuscular  lag  time  constant  in  sec 
Lower  bound  on  the  domain  of  T„  in  sec 

P 

Bolling  subsidence  time  constant  for  the  helicopter 

Fixation  (scanning)  interval  in  sec 

Mean  fixation  (scanning  or  sampling)  interval 
in  sec 

Mean  fixation  interrupt  interval,  -  Td 

Deviation  in  the  longitudinal  component  of  inertial 
velocity  from  trimmed  value  in  ft/see 

Command  velocity  in  ft/sec 
Velocity  error  in  ft/sec 
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Random  longitudinal  gust  velocity  in  ft/sec 


xe> 


Y  .  Yc(>) 


Yh>  YH' 


yol»  yoi/^ 

V  Yp(  Joj) 


Y  ,  Y  (jo>) 


1  -  f| 

1  -  ne 


Visual  Fligut  Rules 

Random  normal  (vertical)  gust  velocity  in  ft/sec 

Displayed  position  error  in  ft 

Longitudinal  force  applied  to  the  controlled 
element 

(l/m  )(5x/&B^  )  in  ft /sec2 

(l/m)(3x/dq)  in  ft/sec 

(l/ra)(5x/du)  in  sec"1 

Controlled  element  describing  function 

Display  describing  function 

Pilot's  perceptual  describing  function, 
representing  operations  such  as  observation, 
scanning,  sampling  and  reconstruction 

Open  loop  frequency  response  function 

Pilot's  adaptive  describing  function,  representing 
operations  such  as  equalization  and  summing 

Pilot's  describing  function  in  operating  on 
displayed  error  of  item  a 

Pilot's  describing  Emotion  in  operating  on 
displayed  error  of  item  b 

Pilot's  compensatory  describing  function  in  general 

Pilot's  pitch  attitude  describing  function 

Pilot's  roll  attitude  describing  function 

Mean  fixation  Interrupt  fraotio.i 
Mean  effective  interrupt  fraction 

Mean  foveaJ  interrupt  fraction 
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xvlU 


Effective  low  frequency  phase  coefficient  in  the 
extended  crossover  model; 

M  / 1  ^  \ 

a  <*  Z  (t“  “  I  i  M,  an  integer  which  reflects 

i«1\  L  "1/  ^  the  number  of  lower  frequency 
leads  and  lags 

Value  of  a  computed  near  unit-gain  crossover  from 
describing  function  measurements 

Normalized  lower  bound  on  the  domain  of  Tg,  To/Tg 


Lateral  cyclic  rolling  moment  control  displacement  In 
rad 

Same  as  &e 

Collective  lift  control  displacement  in  rad 

Longitudinal  cyclic  pitching  moment  control 
displacement  in  rad 

Incremental  low  frequency  phase  coefficient,  e.g., 
such  as  that  caused  by  parafoveal  perception 

Incremental  time  delay  which  is  a  function  of  (...) 

Pilot's  incremental  time  delay  caused  by  scanning, 
sampling  and  reconstruction 

Pilot's  incremental  time  delay  caused  by  low  frequency 
lead  equalization 

Damping  ratio  of  a  second  order  dynamic  system 
Damping  ratio  of  a  second  order  lag 
Damping  ratio  of  a  second  order  lead 

Mean  fixation  dwell  fraction,  fractional 

scanning  workload,  probability  of  fixation 

Value  of  for  CHT  display 

Mean  effective  dwell  fraction  ■  /? 

de  * 

Mean  foveal  dwell  fraction 


TJpjj  Mean  fixation  dwell  fraction  on  flight  director 

^  Mean  fixation  dwell  fraction  on  altitude  and 

‘ ’  vertical  speed  displays 

Mean  fixation  dwell  fraction  on  airspeed  > 

'  AS  display 

0  Pitch  attitude  angle 

9  Pitch  attitude  command 

c 

0e  Pitch  attitude  error 


X  Inverse  time  constant  of  the  first  order 

divergence  in  the  controlled  element  of  the 
(unstable)  subcritic al  tracking  task 

Xc  Critical  limiting  value  of  X 


XCA' 


X 

s 


Xj. )  Ui 


9 


V  Xh 


CRT 


"h,  f, 


u 


AS 


c. 


Cross -adaptive  or  subcritical  value  of  X,  when 
the  subcritical  tracking  task  is  employed  to 
measure  excess  control  capacity  by  adapting  X 
as  a  function  of  primary  task  error 

Altitude  divergence  parameter 

Roll  attitude  (spiral)  divergence  parameter 

1 

Altitude  divergence  parameter 

i 

Fixation  or  look  fraction 

Fixation  or  look  fraction  on  Cathode  Ray  Tube 
display  ' 

Fixation  or  look  fraction  on  altitude  and 
vertical  speed  displays 

Fixation  or  look  fraction  on  airspeed  display 


3.1 4159...;  also  used  for  look  fraction  in  some 
of  the  original  literature 


Error  coherence, 


Velocity  error  coherence 


Signal  variance  in  tine 
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xx 


!»•  fV> 


T 


T 

e 


Stamdarf.  &*7l£ *Lzs  (HHS  oh 

relccity  ?  err*.  in  f-.'evc 

Time  y&riazce  of  the  cc ■sa&.V.  vcl jtity  input 
in  (ft/ sec/' 

Standard  dc ris.ti.cn  (HlS  value)  of  ’ceea  oocrard 
in  ft 

•Tins  variances  of  the  (displayed  error)  displace¬ 
ment  ins  first  derivative  to  ’which  the  human 
operator  ic  responding 


Input  -c  or  related  error  variance 


Ptcorr^lared  error  variance  (caused  by  remnant) 


Ccmrssmd  input  or  forcing  function  variance 


Human  operator’s  HIS  fixation  avail  interval  or 
standard  deviation  in 

Hunan  operator's  RM?  fixation  scanning  or 
sampling  interval  or  standard  deviation 


Velocity  error  variance 


Command  velocity  input  variance 


Standard  deviation  (RK3  value)  of  longitudinal 
gust  velocity  in  ft/sec 

Standard  deviation  (RM3  value)  cf  normal  (vertical) 
gust  velocity  in  ft/sec 


Pilot '8  time  delay,  sec,  due  to  latencies  in 
perception,  neural  conduction,  and  coding 


Effective  tine  del  ly  in  the  crossover  model, 

M  M/2U 

+  X  (tt  -  tt)  ,+  — 

>■  I  L  J  k^A”! 


%  -  t  +  TD  +  IH 


M,  N,  sre  integers  which  reflect  tr.e  number  of 
higher  frequency  lead  ana  leg  contributions  from 
the  oispl.-.y,  pilot,  and  controlled  element 


Val'.ie  of  Tg  computed  near  unit-gain  crossover 
from  describing  function  measurements 

Effective  time  delay  for  response  to  motion  tut; 


v,  Value  Tp  for  zero  forcing  function  bandwidth 

(co1  -  3) 

<p  Roll  attitude  angle 

9e  Roll  attitude  error 


*i 


Phase  angle  of  the  i^  sinusoidal  component  in 
the  quasi -random  command  velocity  input j  also 
used  for  probability  of  fixation  in  some  of  the 
original  literature 

Phase  margin 


Computed  value  of  the  phase  margin  at  unit-gain 
crossover  from  desc-'bing  function  measurements 


0,  4(oo) 


Power  spectral  density  in  ( units 


per  rad/sec 


*cc' 

^ee(m) 


,*'eei 

®eeD 

«u, 


Total  control  output  power  spectral  density  in 
(units)2  per  rad/sec 

Error  power  spectral  density  in  (.units/  per 
rad/sec 

Portion  of  $ee  which  is  input-correlated 

Portion  of  4ee  which  is  uncorrelated  with  input 

Input  power  spectral  density  in  (units)2  per 
rad/sec 


Power  spectral  density  of  aural  tracking  remnant 
in  ( units )2  per  rad/sec 


rnn» 


,  4  (u>) 


mu. 


Remnant  power  spectral  density  referred  to  the 
opeiator'e  input 


Normalizt  o.  power  spectral  density  of  processing 
remnant,  *nnp/<£  “  *nnJ^ 


V*»% 


Power  spectral  density  of  motion  cue  remnant  in 
2 

(units)  per  rad/sec 

Power  spectral  density  of  residual  remnant  in 
( units per  rad/sec 

Power  spectral  density  of  processing  remnant 
in  (units per  rad/sec 

Pover  spectral  density  of  scanning  or  sampling 
remnant  in  { units j  per  rad/sec 

Normalized  power  ppectral  density  of  scanning  or 
sampling  remnant, 

Circular  frequency  in  rad/sec 

Unit-gain  crossover  frequency;  crossover  gain 

Computed  value  of  u>c  from  describing  function 
measurements 

Crossover  frequency  with  continuous  foveal 
attention 

Crossover  frequency  with  Cv  ^inucui  p jveal 
attention 

Forcing  function  bandwidth  ’n  rad /sec;  also 
circular  frequency  of  the  i'1'*  sinusoidal  oorspcrant 
in  the  quasi -rsindora  command  v<  .U city  input 

Undamped  natural  frequency  of  a  &  sound  order  las'; 
in  rad/sec 


t 

I 

! 


I 

\ 

I 

1 

f 


% 

% 

%T) 


Undamped  natural  frequency  of  a  second  or-ie”  l?aa 
in  rad/sec 

Unstable  frequency  in  rad/3ec 
Computed  value  o'  cc^ 

Circular  fixation  \  canning)  frequency  in  rad/sec 

Fixation  scanning  frequency  m  .  h-  flight  -irtetor 
in  rad/ sec 


fp  *) 


i  ; 


fi  Effective  parafovaal-to-foveol  gain  ratio, 

%  -  n 
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Mathematical  3ymbols 
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=> 


a 


I 

E 


o 


X 


LesB  than 

Greater  than 

Less  than  or  equal  tc 

Greater  than  or  equal  to 

Much  less  than 

Much  greater  than 

Not  equal  to 

Approaches/  approximately  equal  to 

Identically  equal  to 

Fed  to/  approaches 

Identified  with 

(raised  bar)  average  value 

(raised  period)  d/dt 

Differentia],  operator 

Partial  differential  operator 

Integration  operator 

Summation  operator 

Location  of  a  transfer  function  zero  in  the 
complex  s -plane 

Location  of  a  transfer  function  pole  in  the 
complex  s -plane 

Add  it1  'a  ope  rator 

Oi  jDhen)  subtract;!  on  operator;  negative  value 
prt  fix 


SECTION  I 


INTROKJCTION 

The  ability  to  describe  in  &  predictive  model  the  various  vays  in 
which  a  human  pilot  can  function  as  c  controller  and  instrument  monitor 
will  achieve  direct  and  important  savings  in  the  design  ani  evaluation  of 
displays.  Figure  T-1  shown  a  framework  for  such  a  description.  The  entire 
display-pilot«»coni  rol-vehicie  combination  is  considered  as  a  multiloop 
feedback  control  system.  One  or  more  controlled  elements  correspond  to 
the  dynamics  of  vehicle  response  to  control.  Controlled  elements  are  sub¬ 
jected  to  environmental  ard  internal  disturbances,  d,  such  as  wind  gusts 
and  hydraulic  power  supply  fluctuations.  A  human  operator  will  pilot  the 
controlled  elements  through  control  actions,  c,  by  perceiving  several 
loop  closure  possibilities.  These  possibilities  may  be  both  directly- 
controlled  outputs,  m,  and  displayed  inputs,  commands,  or  Implicit  environmental 
functions,  i,  such  as  intruding  aircraft  or  terrain  height  along  the  intended 
flight  path  (pursuit  displays);  or  the  possibilities  lor  display  may  represent 
only  differences  between  i  and  m  called  errors  (compensatory  displays). 

The  display/control  system  for  the  vehicle  is  to  be  synthesized  so  is 
to  improve  piloted  system  performance  to  a  point  where  a  set/  (or  subset) 
of  mission  requirements  can  be  satisfied.  In  system  engineering  terms,  the 
improvement  of  performance  implies  greater  frequency  bundwidths  and  cor  -e3pond- 
ingly  reduced  closed-loop  system  lags  and  errors  In  following  commands  and 
suppressing  disturbances.  In  terms  of  pilot  behavior,  the  improvement  of 
performance  implies  reduced  effective  time  delay,  reduced  pilot-generated 
noise;  increased  allowable  range  of  pilot-gain  variation  consistent  with 
closed-loop  system  stability;  and  reduced  workload  to  a  level  where  he  is 
efficiently  and  gainfully  occupied,  yet  able  J  r>  cope  to  a  prescribed  degree 
with  the  unexpected  while  he  obtains  and  maintains  the  system  performance 
required  by  the  tusk. 

In  previous  reports  in  this  series  (Refs.  I  and  2)  ii  was  shown,  in 
connection  with  both  fixed  wing  arid  rotary  wing  aircraft,  how  a  display/control 
system  might  be  synthesized  for  the  conventional  c a&e  of  separated  instruments . 
In  particular,  calculations  were  made  of. 


Figure*  1  .  Scope  o±  Manual  Control  Display  Theory 


®  the  quantities  which,  of  necessity,  had  to  be  displayed 
to  enable  the  specified  raissiot.  phase  (instrument  approach) 
to  be  performed 

®  the  pilot's  appropriate  dynamic  behavior  in  acting  on  the 
displayed  quantities 

©  system  performance  iiieasures,  such  as  rms  errors  and  pilot 
workload  data  including  fixation  times  and  frequencies  on 
each  instrument 

©  the  preferred  arrangement  of  displays 

Considering  the  relatively  undeveloped  state  of  theoretical  knowledge  on 
vhich  the  calculations  were  predicated,  the  dwell  fractions  and  link 
probabilities  resemble  later  measurements  in  the  case  in  which  there  has 
been  a  direct  comparison  to  be  made  between  the  predictions  and  the  results 
of  experiment.  (See,  for  example,  Pig,  3,  Ref.  3  which  is  incorporated 
here  as  Appendix  A.) 

The  prediction  of  system  performance,  workload,  and  preferred  display 
arrangement  for  separated  displays  dees  not,  however,  address  a  contemporary 
question  of  practical  interest.  There  exists  a  conviction,  supported  by 
both  theoretical  and  experimental  evidence,  that  for  high  precision  tracking, 
such  as  in  landing  approach  under  instrument  flight  rules  (IFR) ,  it  is 
necessary  to  combine  or  "integrate"  displays.  While  the  conviction  is 
commonly  held,  there  does  not  seem  to  be  any  commonly  understood  definition 
of  an  integrated  display,  nor  any  accepted  answer  to  the  question:  "How  is 
the  display  properly  integrated?"  A  brief  survey  (Ref.  4)  shows  a  tremendous 
variety  of  "integrated"  displays  even  for  the  single  mission  phase  of  instru¬ 
ment  low  approach.  This  tremendous  variety  is  very  likely,  in  part,  the  result 
of  a  technique  in  experimental  display  research.  For  example,  system  performance 
measures  such  as  mean  square  tracking  errors  and  pilot  workload  treasures  such 
as  mean  square  control  deflections  are  often  used  to  evaluate  the  relative 
merit  of  displays.  Yet  these  same  measux-es  do  not  necessarily  vary  appreciably 
with  large  variations  in  the  qualities  of  the  display.  On  the  other  hand, 
theixj  may  be  at  the  same  time  a  strong  preference  on  the  pert  of  the  auh  jects 
of  an  experiment  for  one  form  of  display  over  another.  An  analogy  to  the 
field  of  aircraft  handling  qualities  research  strongly  suggests  that  such 
changes  in  pile;  preference  or  opinion  are  correlated  with  changes  in  bsnavior 
required  bo  maintain  the  specified  performance  by  working  to  control  in  stpiu- 
of  variations  in  difficulty,  -h.  1  i t  apparently  w;  yhoulci  look  for  such  changes 


in  the  pilot's  behavior  when  vising  variations  in  the  information  which  is 
displayed. 

Curiously,  perhaps,  in  view  of  the  large  amount  of  experimental  work  on 
displays,  our  ability  to  postulate  perceptual  behavioral  models  far  exceeds 
our  ability  to  generate  believable  experimental  evidence  which  would  tend 
to  validate  them.  This  incongruity  is  for  the  reason,  described  above, 
that  very  often  the  only  measurements  which  are  made  concern  mean  squared 
tracking  errors  and  control  displacements.  Such  measurements  are,  of  course, 
necessary  (but  not  sufficient)  for  determining  whether  a  particular  system 
is,  in  fact,  satisfactory.  Mean  squared  error  and  control  measurements 
alone  leave  much  to  be  desired  in  determining  the  cduses  of  and  corrections 
for  difficulties,  except  by  ad  hoc  adjustments  which  may  in  themselves 
be  influenced  by  some  artificial  characteristics  of  the  simulation. 

Therefore,  no  improvement  in  the  display  design  process,  nor  indeed  in  the 
more  general  problem  of  cockpit  layout,  is  to  be  expected  until  we  have  in 
hand  a  validated  theory  for  cause  and  effect  in  perceptual  behavior  in 
particular,, and  workload  in  general. 

Such  a  theory  of  perceptual  behavior,  if  it  existed,  would  never 
coraplete3,y  replace  expeilraentation  in  display  design,  development  and 
evaluation, but  it  would  enhance  the  efficacy  of  these  processes  by  helping 
one  to: 

®  Predict  experimental  possibilities  which,  in  turn,  help 
one  to: 

( 1 )  suggest  relatively  critical  experiments 

(2)  guide  the  experimental  design 

®  Interpret  experimental  findings 

©  Discover  limitations  on  experimental  results  by 
Identifying  task  variables  which  would  change  the 
results 

®  Provide  a  basis  for  extrapolating  experimental  findings 
to  different  applications 

It  was  to  the  elaboration  of  such  a  theory  of  the  effects  of  format 
and  content  on  perceptual  behavior  in  using  "integrated"  displays  and  to 
the  acquisition  of  a  suitable  data  base  that  the  research  reported  here 
was  addressed. 


•m 


h 


In  particular,  it  was  hoped  to: 


©  Answer  four  questions  posed  by  the  JAHAIR  Committee 
in  1$$6  when  research  on  the  theory  of  manual  control 
displays  was  first  initiated,  viz. , 

{ 1 )  What  ic  an  integrated  display? 

(2)  How  may  the  proper  signals  for  manual  control 
of  a  task  be  predicted  and  verified? 

(5)  How  is  the  display  properly  integrated? 

(4)  How  can  the  display  be  evaluated? 

©  Separate  the  controllability  and  precision  of  the  task 
from  the  attentional  workload  in  using  the  display  by 
using  special  measures,  such  as: 

(1)  pilot's  describing  function  gain 

(2)  effective  time  delay 

(3)  error  coherence  (relative  remnant) 

(4)  excess  control  capacity 

(5)  display  ratings 

(6}  eye-point-of-regard 

®  Quantify  measures  of  attentional  workload  as  functions  cf : 

(1)  display  size,  subtended  field  of  view,  and 
density  of  symbols 

(2)  form  of  the  symbols 

(3)  display  content  (e.g.  "quickeued"  command, 
situation,  etc.) 

©  Codify  ihe  empirical  results  in  a  theory  having  predictive 
value  for  new  task3  and  integrated  display  designs. 

More  specifically,  we  note  that  in  performing  precise  compensatory 
tracking  tasks  such  as,  for  example,  in  landing  approach  under  instrument 
flight  rules  (l FR),  pilots  should  be  provided  with  preferably  only  one  but 
not  more  than  two  distinctly  separate  displays  for  the  purpose  of  flight 
control.  It  has  been  shown  by  theo1- +  reasoning  (Refs.  1  and  5)  and 
experimental  measurement  (Refs.  6,  7  and  8)  that  in  a  landing  approach  under 
IFR  there  is  sufficient  time  to  fixate  on  not  more  than  two  separate  displays 
with  sufficient  probability  or  dwell  fraction  to  suitably  suppress  scanning 
remnant.  More  than  one  symbolic  signal  may,  however,  be  presented  on  each  of 
two  displays  to  take  advantage  of  pilots'  parafoveal  perceptual  ability. 

Each  display  may  then  be  called  a  "combined'"  or  "integrated"  display.  Inte  • 
grated  displays  have  necessarily  evolved  from  the  pilot’s  inner  control  loop 
displays,  such  as  the  gyro  horizon  and  compass,  because  the  pilot  must  mon¬ 
itor  a  half-dozen  or  more  multlioop  situation  variables  even  tc  maintain 


confidence  in  U3ing  a  tvo-axis  flight  director  display.  In  reality,  of 
course,  especially  in  V/STOL  approaches,  there  are  three  axes  which  require 
precision  control,  vis  ,  longitudinal,  as  veil  as  vertical  end  lateral,  so 
that  an  integrated  display  for  precise  approach  conxrol  under  IFR  is  then 
most  essential  to  maintaining  a  tolerably  unsaturated  level  of  pilot  workload. 
Provided  that  it  does  not  become,  ’’cluttered1',  the  combined  presentation  of 
signals  in  a  single  display  vi 11  allow  the  pilot  to  increase  his  effective 
dwell  fraction  on  any  particular  displayed  signal  by  using  parafoveal  per¬ 
ception.  By  helping  the  pilot  to  increase  his  effective  dvell  fraction, 
integrated  displays  can  have  a  profound  influence  in  reducing  pilots’  mcn- 
itoi  ing  workload,  and  this  may  possibly  be  measured  in  terms  of  a  reduction 
in  the  task-related  scanning  remnant. 

Reference  9  shows  that  relative  scanning  remnant  power  or  relative 
incoherent  error  power  is  directly  proportional  to  the  effective  fraction 
of  time  between  "looks"  at  the  given  displayed  error.  It  is  desirable  to 
keep  the  tracking  error  coherence  aa  high  as  possible  (or  to  Keep  the  error 
incoherence  as  low  as  possible)  to  achieve  the  best  t&3k  performance  within 
the  constraint  of  attentional  workload,  of  which  scanning  workload  is  one 
measure.  One  way  is  to  increase  the  foveal  dwell  fraction  on  aach  object 
of  fixation,  but  this  is  limited  by  the  physical  upper  bound  on  scanning 
workload,  which  cannot  exceed  unity.  The  other  way  for  a  pilot  to  increase 
tracking  error  coherence  is  to  increase  his  average  parafoveal  tracking 
gain  up  to  a  level  where  the  closed-loop  reunant  i3  not  amplified.  This 
can  be  successful  if  the  display  format  allows  the  pilot  to  maintain  an 
average  parafoveal  tracking  gain  which  is  a  large  fraction  of  his  foveal 
gain. 

It  was  with  a  view  toward  a  better  understanding  of  interactions  among 
parafoveal  perception,  error  coherence,  display  format  and  attentional 
workload  that  the  experiments  reported  here  were  conducted. 

The  balance  of  the  report  13  divided  into  three  technical  sections. 

The  first  of  these  reviews  the  tentative  mathematical  models  and  some 
new  definitions  of  terms  which  provide  the  framework  within  which  the 
experiments  were  planned  and  performed.  Here  the  reader,  perhaps  unfamiliar 
with  the  previous  results  of  research  sponsored  by  the  Joint  Army  Navy 


Airox aft  Isstrssaststlsn  Research  (JA3AZ5)  Program.  at  Systems  ~5-oh~ci:gy. 

Ire .  fSZE)  j  ray  acquire  a  knowledge  both  of  tbs  state-cf-tbe-aro  pe rceptuaL 
rede  Is  for  integrated  displays  as  veil  as  the  older  models  for  motor  response. 

ae  models  are  summarised  in  ccnpact  analytical  form  for  the  reader 
who  is  already  acquainted  vita  pilot  modela  for  single-axis  compensatory 
tracking  control  tasks .  Ike  review  of  maifcenaxicei  models  in  Section  II 
is  not  intended  as  a  substitute  for  the  core  thorough  description  and 
validation  of  the  nod  els  presented  in  Ref.  9 — 1*,  to  which  the  dedicated 
practitioner  and  interested  reader  should  refer. 

An  exposition  of  the  ~cnplete  array  of  models  required  for  control 
display  analysis  3s  given  in  Ref.  1,  and  a  narrative  of  the  systematic 
control  display  design  procedure  including  the  nultiaxis  scanning  models 
(Ref.  5)  i?  included  herein  as  Appendix  A-  Terms  vhich  are  used  in  the 
balance  of  this  report,  especially  the  ones  which  are  used  to  describe 
the  measurements  which  were  made  end  the  results  vhich  v/.re  obtained,  are 
defined  in  Section  II  and  in  the  Glossary  of  Technical  Terns. 

As  will  he  pointed  out  subsequently,  two  sets  of  experiments  were  per¬ 
formed.  The  first  set  of  experiments,  which  is  the  subject  of  Section  III, 
were  coicerned  with  single-tods  tracking  with  the  use  of  parafoveal  viewing 
of  displays.  The  second  set  of  experiments,  were  concerned  with  the  effects 
of  display  content  and  format  in  an  integrated  display.  The  latter  experi¬ 
ments  themselves  and  the  results  obtained  are  described  in  Section  IV. 

A  brief  final  Section  summarizes  the  report  and  presents  the  conclusions 
to  be  drawn  from  the  research  results. 

We  have  already  mentioned  the  first  appendix  which  narrates  the  possibilities 
for  systematic  manual  control  display  design.  A  second  appendix  presents  the 
pre -experimental  analyses  for  the  set  of  experiments  which  addressed  the 
effects  of  display  content  and  format  in  an  integ  ted  display.  A  third 
appendix  presents  the  derivation  of  some  new  subjective  rating  scales  pro¬ 
posed  fc  .•  use  in  the  experimental  evaluation  of  control  displays. 
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SECTION  II 


MATHEMATICAL  MODELS  AND  DEFINITIONS 
A.  MODELS  FOR  HUMAN  PILOT  DYNAMICS 

The  human  attributes  of  perception,  response,  Judgment,  and  adaptability- 
lead  to  a  great  number  of  possible  loop  structures  for  a  given  control  task. 

To  cope  with  this  variety  of  possibilities  in  advance  of  any  experiment,  the 
theory  of  manual  control  displays  (Ref.  l)  first  postulate  possible  interpreta¬ 
tions  and  organizations  of  the  input  data  available  to  the  pilot.  Then  the 
theory  postulates  that  the  pilot  will  establish  appropriate  organization  and 
adaptation  of  his  behavior  so  that  the  data  may  be  used  for  effective  control. 

In  preliminary  design,  manual  control  display  theory  can  serve  as  a  tool 
for  the  pilot-vehicle  system  analyst  by  providing  the  set  of  rules  for  select¬ 
ing  the  mathematical  pilot  model  appropriate  to  a  particular  situation. 

However,  in  the  application  which  concerns  us  here,  the  theory  is  being  tested 
for  its  ability  to  predict  and  explain  attributes  of  human  behavior  observed 
In  controlled  experiments.  As  a  result  of  these  tests,  we  may  be  able  to 
extend  or  improve  the  characterization  of  a  sample  of  pilot  behavior  in  terms 
of  task  variables,  operator-centered  variables,  and/or  procedural  variables 
in  these  specific  experiments. 

Manual  control  theory  characterizes  human  behavior  in  terms  of  1 )  mathe¬ 
matical  models  which  express  the  dynamic  motor  response  of  the  pilot  to 
various  sensory  stimuli  and  2)  verbal- analytical  models  which  express  the 
adaptation  of  the  pilot  population  to  the  task  variables.  Not  all  of  these 
models,  however,  are  based  on  sufficient  experimental  data  to  be  definitive. 

This  does  not  mean  that  these  models  lack  usefulness.  In  all  cases,  the 
models  are  sufficiently  developed  to  permit  relative  dynamic  performance  and 
workload  estimates  to  be  made.  In  these  experiments,  we  are  simply  trying 
to  characterize  more  definitely  the  dependence  (or  independence)  of  pilot 
behavior  on  properties  of  display  format.  Pilot  models  are  described  and 
reviewed  in  Refs.  1,  10,  11,  12  and  1  ’I.  Only  a  synopsis  of  the  simplest 
of  models  for  compensatory  single-loop  control  will  be  given  here  so  as  to 
introduce  the  reader  to  the  form  of  the  models  and  to  some  of  the  terminology 
used  in  describing  the  models. 
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In  a  :losed-loop  compensatory  control  task  (Fig.  II-1 )  the  pilot  responds 
"^e  displayed  error,  e,  jetween  a  desired  command  input,  i,  and  the  comparable 
vehicle  output  motion,  m,  and  produces  a  control  action,  c.  The  control 
servo  actuator,  vehicle,  motion  sensor,  and  display  dynamics  are  combined 
and  represented  by  the  "controlled  element"  transfer  function,  Yc(s),  which 
expresses  the  Laplace  transform  M(s)  in  terras  of  C(s).  Compensatory  single¬ 
loop  pilot  models  comprise  both  a  describing  function*,  Ype(j<n),  and  an 
additive  "remnant"  power  spectral  density,  $nne>  as  shown  in  Fig.  II-1 . 

The  portion  of  the  pilot's  control  action  which  is  linearly  correlated  with 
the  input  is  represented  by  the  quasi-linear  describing  function  Vjo.) 
operating  on  the  error  signal,  e.  It  also  includes  the  effects  of  the 
control  manipulator  "feel"  characteristics.  The  remnant  is  defined  as  the 
portion  of  the  pilot's  control  output  power  which  is  not  linearly  correlated 
with  the  system  input.  As  shown  in  Fig.  II-1 ,  the  remnant  can  be  repre¬ 
sented  by  an  additive  noise,  characterized  by  a  power  spectral  density, 

®nne,  in  the  quasi-linear  pilot  model.  The  total  control  output  power 
spectral  density,  flccC05)*  is  thus  the  sum  of  two  linearly  uncorrelated 


Quasi-Linear  Pilot  Model 


$nne  the  power  spectral  density  of  the  remnant 
referred  to  the  operator's  input 

Figure  II-1 .  Block  Diagram  for  the  Compensatory 
Quasi-Linear  Pilot  Model 


*The  terra  describing  function  is  applied  to  emphasize  that  this  is  not 
a  "human  transfer  function".  The  remnant  must  be  added  to  complete  the  model, 
and  the  describing  function  is  appropriate  only  for  continuous  random-appear¬ 
ing  signals  of  relatively  low  bandwidth.  It  is  strictly  valid  only  in  the 

frequency  domain  and  should  not  be  used,  without  appropriate  modification,  to 
compute  the  system  response  to  a  deterministic  input. 
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-  [ip^O  +  Vc)]2^®)  +  Wo)] 

where  $ ,  _j  =  tbe  input  xcver  spectral  density 

-Jjjj.  =  tiie  rerrant  power  spectral  density  referred 
~  to  the  operator’s  input 

Sa  remaarrt  has  been  measured  as  a  continuous  and  smooth  power  spectrin 
in  tracking  experiments  of  a  tire  duration  sufficient  to  define  the 
operator's  describing  function  over  a  bread  frequency  band.  Sources  of 
remnant  ssy  not  l»e  uniquely  determined  using  only  two-terminal  measure - 
cents.  However ,  on a  car.  infer  the  dominant  sources  of  remnant  from  contrived 
experiments  vi^h  particular  task  variables  such  as  continuous  attention, 
scanned  end  sampled  attention,  displayed  signal  thresholds  and  quantization, 
lov-freqaency  lead  equalization,  unstable  controlled  elements,  and  non¬ 
stationary  arialoe,  pilots.  Inferred  sources  of  the  remnant  in  ascending  order 
of  importance  for  single-axis  tasks  are  believed  to  be:  pure  noise 
injection,  nonlinear  action,  and  non-steady  operator  behavior. 

For  examples  of  pure  noise  injection,  Ref.  50  suggests  two  models  for 
generating  low  frequency  lead  equalization  within  the  human  operator  which 
inherently  produce  noise,  although  the  subject  may  appear  to  devote  continuous 
attention  to  his  single-axis  tracking  task.  In  some  raultiaxis  tasks,  as  we 
shall  subsequently  discuss,  pure  noise  injection  caused  by  scanned  and  sampled 
attention  can  become  dominant. 

A  model  for  the  remnant  can  satisfactorily  be  taken  to  be  a  signal  with 
a  power  spectral  density  which  is  a  function  of  tha  pilot's  lead  equalization, 
the  error  variance,  and  the  "difficulty"  of  the  controlled  element.  Reference 
52  has  shown  th3t  the  power  spectral  density  of  the  human  operator's  remnant 
for  certain  (single-axis)  tracking  situations  can  be  represented  simply  by 
injecting  white  noise  processes  at  the  operator's  input  whei’e  each  state 
variable  is  perceived.  The  power  spectral  density  of  each  injected  white 
noise  process  is  proportional  to  the  variance  of  the  (error)  signal  being 
perceived.  As  explained  in  Ref.  55  a  number  of  quasi -random  sampling,  recon¬ 
struction,  and  derived-rate  processes  os  -11  as  Weber-Law  errors  in  tracking 
control  action  all  lead  to  wide -band  ■remnant  whose  power  spectral  density  is 
uniform  at  low  irequencies  end  proportional  to  the  variance  of  the  error 
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3-gnai  displayed  to  tbs  human  operator.  Therefore,  the  -oot  consistent 
results  seen  to  be  obtained  if  the  re-enact  is  taken  to  be  injected  at  the 
pilot's  input  (see  Pig.  11-1 ) ,  although  in  special  cases  die cussed  next  it 
is  preferable  to  inject  the  regnant  at  the  pilot's  output. 

If  all  sources  of  re enact  cover  vere  proportional  to  the  displayed  error 
variance,  the  remnant  should  disappear  when  no  external  input  (and,  hence, 
no  Input-correlated  error)  is  present.  Hovevei ,  the  experiments  reported  in 
Ref.  pi  show  that  sene  output  remnant  is  present  in  the  absence  of  any 
external  input.  Tne  cause  is  the  cumulative  effect  of  the  ''residual”  sources 
described  in  Ref.  19*  Hence,  the  name  "residual  remnant"  is  given  to  that 
noise  which  is  present  in  the  human  operator’s  control  output  even  without 
ary  external  Input  and  without  the  need  for  low-frequency  lead  equalization. 
It  is  preferable  to  model  the  residual  remnant  by  injecting  a  noise  process 
at  the  pilot's  output.  (Vide  Ref.  19.) 

Hie  describing  function  comprises  two  parts: 

(1)  a  generalized  mathematical  operational  form 

(2)  a  set  of  rules  which  specify  hew  to  select  the 
parameters  in  the  generalized  form  so  that  it 
becomes  an  appropriate,  albeit  approximate, 
model  of  human  behavior  for  the  particular 
task  of  interest. 


The  linear  theory  of  servomechanisms  suggests  that,  for  reasons  explained 
in,  Ref.  12,  the  describing  function  of  the  pilot  ought  to  be  adjusted  in  such 
a  way  that  the  open-loop  frequency  response  function,  YQL(  joi),  of  the  single¬ 
loop  compensatory  system  in  Fig.  II-1  will  he 


Y0L(j(n)  =  Y0  (jo))Y0(j(n) 

1  *  6 


0>c 

“  e  ;  a)  near  C'c 

jo>  . 


This  is  called  the  "extended  crossover  model"  (See  Refe.  10,  11,  12  and  13). 

The  unit-gain  crossover  frequency,  oic,  is  equivalent  to  the  loop  gain  product 

^CpeKe-  Te  is  the  effective  time  delay,  and  a  is  the  effective  Idw  frequency 

phase  coefficient,  all  In  the  open-loop  describing  function  Y  Y  (See  Fig  XI- 1 ) 

•^6 

The  difference  between  l80°  and  the  phene  angle  of  the  (complex)  describing 
function  at  tne  crossover  frequency,  u>c.  is  the  phase  margin,  q\,.  The  frequency 
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at  which  the  phase  angle  of  the  describing  function  is  -l80°,  is  colled 
the  unstable  frequency.  When  the  controlled  element  demands  lead  equaliza¬ 
tion  by  the  pilot  below  the  crossover  frequency,  Cl  =  i 
'Aere  T^  is  the  lead  equalization  time  constant.  Otherwise,  a  represents 
the  influence  near  the  crossover  frequency  of  very-low  frequency  lead -lag 
dynamics  with  amplitude  ratio  break  points  which  are  below  the  measurement 
bandwidth  in  many  experiments. 

The  display  designer  will  rarely  need  a  model  more  precise  than  the 
extended  crossover  model,  even  for  analyzing  raultiloop  tasks.  With  the 
extended  crossover  model  and  the  set  of  rules  for  adjusting  its  parameters, 
the  designer  can  make  valid  forecasts  cf  pilot  equalization,  effective  time 
delay,  crossover  frequency,  stability  margins,  tracking  performance,  and 
pilot  opinion  rating,  in  manual,  compensatory,  single-loop  tracking  tasks. 
Before  we  proceed  to  show  how  the  extended  crossover  model  can  be  applied 
in  raultiloop  control  tasks,  we  shall  digress  for  a  moment  to  define  some 
new  terminology  which  arises  to  describe  the  pilot's  visual  scanning  and 
sampling  oehavior  among  the  various  sources  of  displayed  inputs  required  in 
a  typical  multiaxis  control  task. 


B.  frrWIAXIS  SCANNING  BEHAVIOR 
1 .  Scanning  Pnenomena  to  be  Describod 

Several  examples  of  pilots'  scanning  phenomena  are  shown  on  the  eye- 
point-of -regard  time  traces  in  Fig.  II -2  for  various  experimental  conditions 
to  be  discussed  subsequently.  Hu-h  trace  records  a  pilot's  eye  saceade 
between  the  central  cathode  ray  tube  attitude  director  display  (CRT)  and  the 
altitude  display  (left  of  center),  or  the  airspeed  display  (right  of  center). 
After  a  saccade,  denoted  by  the  abrupt  steps  in  each  trace,  the  eye  fixates 
or  dwells  on  the  "isplay  of  concern  for  a  brief  interval  before  the  next 
saccade.  We  often  speak  of  the  pattern  of  saccades  and  fixations  as 
generating  e  pattern  of  scanning  "traffic1'  or  fixation  transitions  among 
instruments  or  displays.  The  circled  enlargements  of  portions  of  the  ti  aces 
show  thst  secondary  fixation  transitions  also  occur  between  symbols  with!'. 
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Figure  II -2 .  Horizontal  E?R  lime  Traces  on  Two  Pilots 
fox  Various  Experimental  Conditions 


the  central,  integrated  CRT  and  between  the  altitude  and  altitude  rate 
meters  left  of  center.  Reference  3  also  presents  several  examples  of 
pilot's  scanning  patterns  on  different  panel  arrangements.  Obviously, 
however,  one  must  speak  of  a  foveal  scanning  pattern  among  "symbols"  in 
the  case  of  an  integrated  display,  rather  than  among  "instruments"  as  we 
shall  do  in  most  of  what  follows . 

furthermore,  an  observable  foveal*  scanning  pattern  may  be  accompanied 
by  a  parafoveal  scanning  pattern  which  is  not  directly  observable  bj,  measur¬ 
ing  eye  movements.  However,  the  presence  of  parafoveal  awareness  is  indirectly 
observable  by  its  influence  on  the  pilot's  describing  function.  We  shall 
return  to  discuss  this  effect  subsequently. 

Although  we  shall  be  speaking  primarily  about  the  visual  modality,  the 
pilot  can  also  choose  to  use  or  ignore  motion  and  aural  cues.  While  this 
is  not  quite  like  sampling,  cue  more  or  less  continuous  use  of  the  vestibular 
or  aural  modality  is  akin  to  a  process  of  selection  when  these  cues  reinforce 
the  visual  modality. 

Scanning  of  an  instrument  panel  permits  the  displayed  information  to  be 
sampled  foveally  during  a  variable  foveal  fixation  dwell  time  interval  on 
the  order  of  one-half  second  or  more.  Between  fixations  the  information 
may  perhaps  be  observed  paraToveally.  Each  saccade  in  Fig.  II -2  describes 
the  direction  of  a  foveal  fixation  transition  between  two  instruments,  after 
which  the  visual  axis  of  fixation  will  pause  or  dwell  on  an  informative  part 
of  the  instrument  (e.g.,  the  tip  of  a  pointer)  before  beginning  the  next 
transition.  Measurements  have  shown  variability  in  the  time  interval  which 
elapses  between  successive  fixations  on  the  same  instrument.  This  time 
interval  is  called  the  scan  interval  or  sampling  interval.  It  will,  in  gen¬ 
eral,  exhibit  a  different  ensemble  average  value  for  each  instrument . 

Besides  Instrument  to  instrument  scars,  scanning  occurs  among  the 
elements  of  combined  displays.  For  instance,  secondary  fixation  transi¬ 
tions  within  the  two-axis  attitude  director  on  various  symbols,  indices,  and 
scales  have  bee  observed,  bun  not  yet  analyzed,  j.u  the  experiments  of  Ref.  6., 


♦Foveal  perception  is  "seel/g  where  ,,  u  arc  fixating." 
parafoveal  perception  is  'Vee5ng  without  looking,"  but  more 
" '.-.t e l eg  without  fixai 
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Thus*  the  addition  of  a  third  axis  to  a  flight  director  for  direct  lift 
e  introl  which  requires  a  separate  f oveal  fixation  may  deprive  the  pilot 
of  time  which  would  otherwise  be  spent  monitoring  the  situation  information, 
unless  a  three "axis  director  presentation  can  be  contrived  to  convey  three 
commands  in  one  fixation  through  feveel  and  parafoveal  channels  of 
awareness . 

The  average  number  of  fixations  in  a  unit  of  time  which  fall  upon  a 
particular  instrument  is  called  the  average  fixation  frequency,  scan  rate, 
or  sampling  frequency.  The  arithmetic  average  scan  rate  will  be  recipro¬ 
cally  related  to  the  harmonic  mean  scan  interval. 

The  proportion  of  the  total  number  of  fixations  which  fail  upon  a 
particular  instrument  is  called  the  average  look  fraction  for  the  instru¬ 
ment.  Its  upper  bound  is  one-half,  which  implies  that  every  other  fixation 
or  look  is  on  the  instrument  with  a  look  fraction  equal  to  one-half. 

The  proportion  of  the  total  time  during  which  fixations  dwell  on  a 
particular  instrument  is  called  the  average  dwell  fraction  for  that  instru¬ 
ment.  Since  the  cumulative  sum  of  all  dwell  fractions,  including  blinks 
and  distractions,  imr  ■.  equal  unity,  by  definition,  the  dwell  fraction  is 
also  termed  "fractional  scanning  workload''  or  "probability  of  fixation". 

The  proportion  of  all  fixation  transitions  which  go  in  the  same  direction 
between  a  pair  of  instruments  is  called  the  "one-way  link -value"  in  the 
specified  direction.  The  sura  of  the  two  one-way  link  values  between  a  pair 
of  instruments  is  called  the  "two-way"  link  value. 

Since  the  scanning  statistics  are  quite  stationary  over  measurement 
intervals  as  short  as  100  sec,  different  one-way  link  values  between  the 
same  pair  of  instruments  would  be  indicative  of  determinism  in  scar,  patterns. 
The  results  in  Ref.  6  snow  no  evidence  of  determinism  in  one-way  link  values. 
Thus,  it  seems  that  pilots'  scanning  behavior  can  be  characterised  as  a 
zero-order  Markovian  process,  l.e.,  that,  given  a  fixation  on  one  instru¬ 
ment,  the  conditional  probability  of  transition  to  a  particular'  different 
instrument  is  independent  of  the  present  (and  past)  fixation.  This 
simplification  proves  useful  In  making  predictions  of  scanning  beiiavio 
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A  summary  of  properties  of  foveal  and  parafoveal  scanning  behavior, 
most  of  which  we  have  Just  discussed  and  some  of  which  are  not  yet 
observable,  except  in  contrived  experiments,  is  presented  in  Table  II -1 . 

Symbols,  nomenclature,  and  some  of  the  interrelationships  which  follow 
by  definition  are  also  given  in  Table  II-1 ,  together  with  a  qualitative 
indication  of  ways  in  which  scanning  affects  the  pilot's  multiloop 
describing  function. 

2.  Describing  Function  and  Remnant  Phenomena  Aooompanying  Boanning* 

As  far  as  we  can  tell  currently,  we  have  not  discovered  a  unique  rela¬ 
tionship  between  observable  foveal  scanning  statistics  and  the  accompanying 
pilot's  describing  function  and  remnant.  Instead,  as  we  shall  describe  in 
the  next  topic,  two  different  limiting  forms  have  been  discovered  for  multi- 
loop  pilot  models  in  control  tasks  (Refs.  1  and  14). 

In  experiments  in  Refs.  9  and  l4  the  foveal  input  information  samples 
are  obtained  from  a  finite  dwell  period,  with  an  average  minimum  dwell 
time  of  about  0.4  sec.  The  pilot's  effective  time  delays  in  closing 
several  loops  Increase  only  slightly  (on  the  order  of  0.05  to  0.1 5  sec) 
because  of  the  necessity  for  scanning,  although  the  pilot  gains  are 
reduced  from  those  that  would  be  expected  on  a  single-loop  basis.  This 
is  not  what  one  would  obtain  with  a  simple  zero-order-hold  sampled-data 
system,  so  the  sampling  and  scanning  theory  required  to  describe  the 
pilot's  eye  movements  has  been  quite  elaborate. 

On  the  other  hand,  among  flight  test  results  from  Gemini  X  during  retro- 
fire  in  Ref.  15>  the  pilot  is  controlling  the  attitude  of  the  vehicle  about 
three  axe*  *,  and  the  measured  yaw  axis  describing  function  exhibits  the 
rather  large  time  delay  predicted  in  Ref.  1  from  an  intersaraple  "reconstruction- 
hold"  modv  1. 

With  the  empirical  facts  as  starting  points,  two  likely  mental  processes 
have  been  proposed,  called  the  "switched  gain"  model  (Ref.  14)  and  the 
"reconstruction-hold"  model  (Ref.  l).  For  the  switched  gain  process  the 
quasi-linear  describing  functions  in  the  several  loops  incur  no  time  delay 
because  of  the  scanning  and  sampling  processes,  although  the  gain  switching 
(multiplexing)  from  loop  to  loop  reduces  the  effective  gain  in  each.  In  the 
reconstruction-hold  model  a  sampling  delay  is  incurred,  but  may  be  largely 
offset  by  lead  equalization  as  part  of  the  signal  reconstruction  process. 
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The  principal  performance  penalty  caused  by  the  scanning,  sampling,  and 
reconstruction  (or  switching)  behavior  is  an  increased  "remnant. "  This 
remnant  depends  on  the  sampling  frequency,  fixation  dwell  time,  and  sampling 
frequency  variations,  as  well  as  the  signal  variance.  The  remnant  acts  like 
an  injected  noise,  and  is  the  real  cause  of  saturation  in  multi-instrument 
displays.  So,  as  we  said  at  the  outset,  measui?raent  of  eye  fixation  is  cer¬ 
tainly  connected  with  pilot  inputs  and  workload  but  the  connection  is  by  no 
means  simple. 

Remnant  is  so  important  in  both  scanning  and  workload  considerations 
and  has  so  many  different  sources  that,  before  presenting  analytical  models 
of  data  for  simplified  situations,  we  shall  summarize  below  the  diverse 
physical  sources  of  remnant.  First  off,  remnant  sources  in  general  are  those 
items  which  contribute,  under  varying  circumstances,  to  pilot  control  movements 
which  are  not  linearly  correlated  (via  the  describing  function)  with  the 
externally  imposed  forcing  functions.  The  remnant  sources  are: 

Observation  Remnant  due  to  poor  coupling  between  the  displayed 
signal  and  tfr'  eye.  Resolution,  retinal  rate  thresholds, 
saturation  levels,  and  refractory  delay  are  of  key  rele¬ 
vance  to  instrument  design. 

Scanning  Remnant  due  to  scanning  and  sampling  of  multiple 

instrument  displays  or  symbols.  To  the  extent  that  para¬ 
foveal  information  can  be  used  for  nonfixated  instruments 
in  an  array  or  for  symbols  within  a  display,  the  parafoveal 
display  perception  is  of  interest  because  it  can  reduce 
scanning  remnant. 

Equalization  Remnant  due  to  asynchronous,  discrete  mental  data 
processing  to  derive  rate  (lead  equalization),  time  and 
amplitude  variations  in  gain,  and  intentional  dither* 

Except  in  properly  designed  flight  directors,  these  are 
dominant  remnant  sources,  and  can  affect  the  remnant  result¬ 
ing  from  use  of  a  given  instrument  design  (e.g.,  if  low 
frequency  lead  generation  is  required,  the  instrument  must 
provide  smooth  data  in  the  low  frequency  range) • 

Kbtion-Cue  Remnant  due  to  vestibular  feedback  noise. 

Crosstalk  Remnant  due  to  neuromuscular  commands  for  other  axes 
in  a  given  control  action  (e.g.,  some  aileron  control 
showing  up  in  elevator  control  inputs). 

Neuromuscular  Remnant  due  to  neural  and  muscular  nonlinear i4-  es 
and  tension  (gain)  variations.  An  important  remnant  source 
is  residual  neural  noise  arid  tremor  whic.i  reran  in  o  ven  when 
no  coraiaand  is  being  followed. 
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In  a  particular  two-terminal  man-machine  measurement  it  is  impossible 
to  separate  out  most  of  these  sources  of  remnant  because  they  dc  not  have 
narrowband  spectral  "signatures,”  and  any  distinct  waveform  effects  are 
blurred  by  the  limited  neuromuscular  response.  Furthermore,  the  central - 
limit-theorem  principle,  coupled  with  the  feedback  around  the  loop,  acts 
to  blend  the  diverse  remnant  contributions  into  a  fairly  wideband  sta- 
stionary  random  process.  This  has  the  important  implication  that  a  simple 
power  spectral  representation  i3  well  suited  co  represent  most  remnant 
(dither  excepted),  while  attempts  to  model  it  with  an  ensemble  of  nonlinear, 

time-varying  deterministic  elements  will  never  be  efficient)  however, 
"analog"  models  may  he  useful  to  check  out  complex  aspects  of  power  spectral 
models . 

Rather  than  attempt  a  detailed  buildup  of  remnant  contributions  from 
each  of  the  sources  listed  above,  we  will  take  a  more  practical 
approach.  Recent  analyses  have  suggested  that  the  observed  remnant 
in  the  error  signal  is  fairly  smooth,  broadband,  and  can  be  considered  as 
resulting  from  an  injected  error-remnant  source  (4>nne)*  In  turn,  the 
measured  injected  error  spectra  are  remarkably  similar  for  a  given-order 
controlled  element.  <J>nne  seems  to  consist  of  two  basic  components:  a 
"residual  remnant,"  0^,  which  exists  and  forces  the  system  even  without 
external  forcing  functions,  and  a  "processing  remnant,"  =  af^nne, 
which  scales  with  the  displayed  error  variance.  Thus: 

^ruig  =  ^nno  +  'J’nrip  =  ^nno  +  °e'Isrme 

where  is  defined  as  that  part  of  <Jnne  which  can  be  normalized  by  the 

displayed  error  variance.  (See  Fig.  II-1  .) 

Scanning  remnant  is  a  particular  form  of  processing  remnant.  It  is 
given  the  symbol  to  distinguish  its  unique  spectral  bandwidth,  which 
depends  on  the  effective  fixation  d*ell  interval  rather  than  the  lead 
equalization  time  constant  (See  Table  II— 1 . ) 

As  it  now  stands,  the  theory  of  multiaxis  scanning  can  be  used  to 
estimate  fixation  probabilities  and  ins  trument-to-instrument  link  proba¬ 
bilities  fairly  accurately  As  an  example ,  Fig.  Il-J  shows  some  predic¬ 
tions  made  with  the  reconstruction-hold  version  of  the  theory  (Ref.  1  ) 
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for  a  landing  approach  using  Eoeing  707  aircraft  dynamics,  as  compared 
with  measurements  (Ref.  6)  made  using  the  DC-8  landing  approach  simulator 
at  the  Ames  Research  Center.  The  resemblance  is  quite  good,  especially 
considering  the  infant  state  of  the  theory  at  the  time. 

This  concludes  a  review  of  the  inspirations  for  eye  movement  studies 
in  flight  control  and  monitoring  tasks,  a  description  of  scanning  phenomena, 
and  a  summary  of  the  relationship  to  pilot  describing  functions  and  remnant. 
In  the  next  topic  we  shall  discuss  two  limiting  forms  of  multiaxis  scanning 
models . 

3.  toiitiaxls  Seaming  Models  for  Control  Tasks 

In  this  subarticle  ve  first  review  the  basic  concepts  of  scanning  during 
multiloop  control  tasks  and  then  give  an  overview  of  two  limiting  forms  of 
our  model  for  the  scanning,  sampling,  and  perceptual  reconstruction  process. 

a.  Review 

1 )  Scanning  During  Multiloop  Control  Tasks.  We  are  concerned  with 
the  class  of  pilot/vehicle  situations  characterized  by  a  closed- 
loop  piloted  multiloop  regulation  or  tracking  task,  having  more 
than  one  display,  and  requiring  manipulation  of  one  or  more  con¬ 
trols.  The  pilot's  selection  of  preferred  display  feedbacks  from 
the  presented  array  has  been  found  to  be  governed  by  a  set  of 
"Multiloop  Feedback  Selection  Rules"  which  have  been  evolved  pre¬ 
viously  and  verified  experimentally  for  integrated  displays  (Vide 
Refs.  1,  11,  among  others). 

Past  work  shows  that  in  the  process  of  extracting  the  feed¬ 
back  information  from  the  displays :  1 )  a  fairly  stationary 

scanning  and  sampling  strategy  evolves  for  a  given  task  and 
instrument  array,  and  2)  the  control  motions  are  much  more 
continuous  than  the  discrete  sampling  would  seem  to  imply  from 
a  pure  stimulus -response  sequence.  Furthermore,  most  of  the 
information  used  in  aircraft  maneuvering  is  of  an  analog  nature, 
displayed  as  the  motion  of  a  moving  pointer  or  scale.  'These 
facts  indicate  tnat  a  form  of  sampled  data  feedback  theory  is 
appropriate  to  model  this  process.  The  facts  further  imply  that  the 
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display  feedbacks  ultimately  selected  would  be  affected  not  only 
by  vehicle  and  task  criteria  (as  with  the  integrated  display 
case),  but  also  by  penalties  from  the  required  scanning  and 
sampling  operations . 

Before  proceeding  let  us  clarify  seme  terms  that  are  used 
frequently  below: 

Scanning  is  defined  here  as  the  process  of  selecting 
and  fixating  each  instrument  in  an  array  of,  or  specific 
portions  of,  a  complex  display  field.  For  the  manual 
control  tasks  a  ’’scanning  traffic  pattern"  is  evolved, 
causing  a  given  instrumeht  to  be  examined  frcm  time  to 
time. 

Sampling  covers  the  perceptual  acts  of:  focusing  on 
eT&LspXay)  interpreting  this  as  an  appropriate  command 
or  error  signal)  arid  perceiving  its  displacement,  rate 
(or  direction),  and,  possibly,,  acceleration  during  & 
sequence  of  fixations.  In  the  present  context,  the 
sampling  does  not  have  to  be  impulsive  or  periodic. 

Reconstruction  covers  the  process  of  extr-apoieting  a 
hypothetical  continuous  signal  using  the  series  of 
samples  available  frcm  each  display,  plus  parafoveal 
(nonfixated)  information  which  may  be  perceived 
between  samples.  Reconstruction  provides  the  mental 
signal  upon  which  the  subsequent  pilot  equalization 
operations  are  assumed  to  operate. 

2)  Description  of  the  Model.  The  development  oi  a  display  scanning 
and  sampling  model  for  multiloop  manual  control  tasks  is  reported 
in  Ref.  1 .  Basically,  it  treats  the  complex  processes  involved 
in  scanning,  selecting,  sampling,  and  reconstructing  internal 
signals  from  an  array  of  dials  as  an  added  "perceptual"  functional 
block  in  a  quasi-linear  description  of  the  pilot.  Figure  II -4e  shows 
the  assumed  basic  model  and  Fig,  II-4b  its  simplified  equivalent. 

The  latter  represents  the  simplest  form  that  can  be  measured  frcm 
inputs  and  outputs  external  to  the  human  operator. 

Let.  us  review  the  key  elements  in  the  basic  model  before 
presenting  its  two  limiting  forms.  The  human  display  control 
behavior  is  represented  by  a  series  of  functional  blocks,  loosely 
labeled  "Fei  v‘tual,rt  "Adaptive,"  and  "Neuromuscular"  in  Fig.  II -4 h . 
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Figure  II-U.  Assumed  Form  of  Pilot  Models 
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Ihe ; signals  shewn  connecting  the  block?  are  unmeasurable  practi¬ 
cally  (being  located  in  the  central  nervous  system),  and,  in  fact, 
the  functions  may  overlap.  It  is  useful  to  consider  the  percep¬ 
tual  block  as  an1  additional  serial  element,  and  to  define  the 
scanning  and  sampling  effects  as  uhe  ratio  between  behavior  under 
continuous,  full -f eve al  tracking  and  the  actual  sampled  tracking, 
in  each  of  the  multiple  loops.  We  will  not  dwell  further  on  the 
adaptive  block  (feedback  selection,  equalization,  summing,  etc.) 
or  neuromuscular  block  (manipulator  interfacing  and  actuation), 
These  have  been  well  documented  in  recent  years  (e.g.,  Refs.  1,  and 

1 0  through  13). 

1 

At  this  time  the  conceptual  model  is  still,  quite  general,  and 
any  of  several  mathematical  or  physical  models  could  be  used  to 

I 

describe  the  above  processes.  Because  of  cur  interest  in  the 
overall,  closed-loop  performance  of  display-pilot- vehicle  systems, 
we  need  a  form  of  analytical  model  compatible  with  feedback  analy¬ 
sis.  After  much  investigation  (much  of  it  based  on  the  background 
information  reviewed,  previously),  wd  have  made  the  following 
assumptions  and  choices  of  yiode,'.  form,  and  have  accepted  certain 
limitations  in  consequence: 

©  The  basic  analytical  models  are  extensions  of  the  quasi- 
linear  descriptions  presently  used  for  nonscanned  multi¬ 
loop  cases  (i.e.,  adjustable,  random-input  describing 
functions,  plus  a  remnant  for  the  incoherent  effects). 
Although  the1  fine-grain  scanning  and  sampling  processes 
are  difficult  to  model  this  way,  the  resulting  pilot 
oiitput  is  sufficiently  continuous  so  that  describing 
functions  can  still  account  for  the  major  closed-loop 
effects.' 

O  It  is  assumed  that  the  pilot’s  learning  process  has 
stabilized  so  that  scanning  behavior  is  stationary  (in 
the  statistical  sense).  Sampling  of  a  given  display  is 
assumed  to  be  "almost  periodic,"  with  appreciable  sta- 
ti stical  fluctuations  which  randomize  the  dat8 ,  Hie 
model  then  treats  the  average  properties  of  tbis  scanning 
during  typical  task  intervals.  Although  sampling  effects 
on  loop  closures  and  scanning  statistics  are  veil  repre¬ 
sented.  this  way,  it  is  not  possible  to  account  for  the 
particular  order  in  which  th'  displays  are  scumed. 


©  The  detailed  high  frequency  effects  of  the  scanning, 
sampling,  and  reconstruction  are  circulated  around  the 
closed-loop  system,  giving  rise  to  a  broadband  "sampling" 
remnant.  This  is  modeled  as  an  injected  noise  at  the 
pilot’s  input  (i.e.,  "observation  noise").  The  sampling 
remnant  is  a  function  of  the  scanning,  sampling,  and. 
reconstruction  processes,  and  may  strongly  affect  which 
physical  loops  are  closed,  the  choice  of  equalization, 
and  closed- loop  performance. 

©  The  resulting  model  for  scanning,  sampling,  and  recon¬ 
struction  comprises: 

a)  A  quasi-linear,  random- input  "perceptual 
describing  function,"  denoted  as  Yh(jcn) 
which  multiplies  the  human  operator's 
continuous  describing  function,  and 

b)  A  broadband  sampling  remnant,  ns,  which 
adds  to  the  basic  remnant,'  and  is  des¬ 
cribed  as  a  spectrum  $>nns  wideband 
observation  noise  injected  at  the  pilot’s 
perceptual  input. 


Examples  of  two  limiting  forms  of  these  sampling  and  recon- 
structioii  models  will  be  introduced  for  compensatory  tracking  loops. 
Either  limiting  form  of  the  multiaxis  scanning  model  is  compatible 
with  the  existing  multiloop  pilot  model  for  integrated  displays. 

For  clarity  in  presentation  we  shall  use  the  modified  crossover 
model  (Y<iYhYpYc),  to  represent  the  display  describing  function 
(Y<j),  the  perceptual  describing  function  (Y^),  the  pilot's  des¬ 
cribing  function  (Ypa,  YPb>  ***)  fran  Fig.  II-4b,  and  the  controlled 
element  describing  function  (Yc).  We  shall  ask  the  reader  to 
visualize  without  benefit  of  repetitious  illustration  the  several, 
additional  (sometimes  coupled)  loops  among  which  the  pilot  must 
scan  his  attention  in  the  relevant  modalities. 

We  shall  now  illustrate  one  of  the  limiting  forms  of  the 
tnuitiaxls  scanning  model  by  incorporating  a  single-axis  model  in 
each  of  two  (among  several)  sensory  channels :  a  foveal  channel 
and  a  parafoveal  channel. 


*0.  A  'Switched -Gain* '  Model  fcr  Multiaxia  Scanning.  This  form  of  the 
model  is  termed  "switched -gain"  because  it  incorporates  a  quasi-random 
finite  dwell  sampling  or  switching  process  between  the  pilot’s  foveal  gain 
and  his  effective  parafoveal  gain  on  each  of  the  several  displays  involved. 
Figure  IX— 5  illustrates  the  model  with  a  block  diagram.  The  ■foveal  path  is 
closed  daring  the  foveal  dwell  interval,  and  the  parafoveal  path  is  closed 
during  the  foveal  interrupt  interval.  Each  of  these  paths  will,  in  general, 
exhibit  different  gains,  equalization  and  effective  time  delays  before  the 
paths  are  combined  in  the  higher  neural  centers  to  send  a  signal  to  the 
actuation  describing  function. 

The  conceptual  block  diagram  in  Fig.  II-5  can  be  remarkably  simplified 
by  recalling  (Ref.  16)  that  any  quasi-randomly  sampled  and  processed  signal 
can  be  modelled  by  1 )  replacing  the  saraplirg  or  switching  process  by  a 
continuous  transmission  path  and  2)  adding  an  uncorrelated  wide  band  noise 
process  whose  power  spectral  density  is  proportional  to  the  variance  of  the 
(displayed)  signal  before  sampling.  Since  the  quasi-random  sampling  process 
has  a  finite  foveal  dwell  interval,  the  wide  band  noise  process  will  exhibit 
a  low-pass  power  spectrum  with  a  first-order  break  frequency  which  is  Inversely 
proportional  to  the  average  foveal  dwell  interval  (Ref.  9)*  The  power 
spectral  density  of  this  foveal -parafoveal  switched-gain  sampling  remnant  is 
described  in  Table  II -2.  Measurements  of  this  switched-gain  remnant  in  Ref.  9 
have  shown  that  it  so  predominates  over  the  other  sources  of  remnant  that  the 
other  sources  cannot  even  be  identified.  This  makes  for  great  simplification 
of  the  remnant  in  the  equivalent  switched-gain  model  shown  In  Fig.  II-6. 

Representation  of  the  pilot's  describing  function  in  the  switched-gain 
model  can  also  be  greatly  simplified.  The  foveal  gain  exceeds  the  para¬ 
foveal  gain  in  all  measurer  nts  which  have  been  made  (Refs.  9>  I**  and  17)* 

This  is  probably  because  of  the  large  displacement  and  increased  rate  thres¬ 
holds  in  parafoveal  perception  by  comparison  with  foveal  perception.  The 
switched-gain  model  is  represented  simply  by  multiplying  the  ratio  (u)  of 
parafoveal  gain  to  foveal  gain  by  the  interrupt  fraction  0  —  tj)  and  adding 
the  product  to  the  dwell  fraction  (tj)  to  obtain  the  effective  dwell  fraction, 


Figure  II- 5-  "S-fitched  Gain"  Multiaxis  Scanning  Model  for  Compensatory 
Multiaxis  Tracking  with  One  Among  Several  Displays 


Norrolized  Power  Spectral  Density  of  Sampling  Remnant, 
OTgO  -  ^e)  units2 
^nngC^)  -  ^  +  (ajIde(/2)2j  rad/sec 

Standard  Deviation  of  Scanning  Interval  a<jg  =  0.5  IB 
Mean  Scanning  Interval  Ts  ,  sec 


where  D 


Tl 

£ra 

\ 

YP 

Yc 


Effective  Dwell  Interval  =  qeTs  ,  sec 

Effective  Dwell  Fraction  t)e  <=.  tj  +  fl(l  -  r|) 

“cp/^cf  -  ratio  of  crossover  gains  for  continuous  parafoveal 
relative  to  continuous  f oveal  tracking  ( 0  <  D  <  1 ) 
foveal  dwell  fraction 

incremental  effective  scanning  time  delay,  normally  negligible, 
except  if  fi  ~*~0,  0.05  <  At  <  0.15  sec 

display  describing  function 

perceptual  describing  function  (Y-n  =  T)ee~^ai^T°) 

pilot's  describing  function 

controlled  element  describing  faction 

crossover  g&in 

effective  time  delay 

x.ow  frequency  phase  approximation  parameter 


Figure  11-6.  Simplifi  A  Equivalent  "Swltched-Gain"  Multi  ax  Is  Scanning 
and.  Tr«  king  Model  for  Compensatory  Tasks 
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TABLE  XI-2 

SAMPLING  REMNANT  POWER  SF2CTPAL  DENSITY 

CD 

0^  a  f  $((o)  dO> 

0 


Definition  of  sampling  remnant  power  spectral  density: 


where 


0 


nn 


(u>) 


O 


^aO  “Tle)(l  -6)cr^  /  units^\ 


is 

is 

% 

is 

is 

5 

is 

0-8) 

is 

0m 

is 

^8 

mean-squared  signal  to  he  sampled 
mean  sampling  interval 
effective  ’dwell  fraction  >»  ^e/Ts 
effective  dwell  interval 

normalized  lower  bound  on  the  domain  of  Ts:  T0/fs 
approximately  o«  /ffi,  the  sampling  variability  ratio 

standard  deviation  in  T8 


Assume  sampling  variability  ratio  (o^/^g)  <0.5  for  skilled  pilots. 
Effective  dwell  fraction  is  related  to  foveal  dwell  fraction;  if  para¬ 
foveal  perception  is  possible  during  interrupt  fraction,  i by  the 
expression 

u>c 

Te  c  %  +  ( 1  -iff)  =  Hf  +  0  -  Tjf)fi 


Cf 


where  is.  is  crossover  frequency  with  continuous  parafoveal 
^  attention  and 

is  crossover  frequency  with  continuous  foveal  attention 

ft  "  ^Cp/^Cf 

Typically,  ^  <  v  for  K/a  controlled  element  with  separated  displays 


(Refer  to  Ref.l8  for  complete  theory  of  sampling  remnant  applied  to 
crossover  model  of  human  operator  tracking.) 


%  =  r\  +  0(1-  n) 

vhere  fl  =  u>c^/ov.,,  =  ratio  of  crossover  gains  for  continuous  parafoveal 
tracking  relative  to  continuous  fovfeal  tracking.  (0  <  Cl  <  i) 

The  effective  crossover  gain  for  the  equivalent  switched-gain  model  in 
Fig.  II-6  is  vhere  is  the  foveal  crossover  gain  in  continuous 

single-axis  tracking  of  the  same  display  and  controlled  element  constrained 
by  the  same  task  variables.  The  low  frequency  phase  approximation  parameter, 
a,  will,  in  general,  account  for  differences  between  foveal  and  parafoveal 
equalization.  There  are  no  apparent  phase  penalties  associated  with  switched- 
gain  scanning  as  long  a3  parafoveal  perception  is  not  completely  inhibited. 
Inhibition  can  occur  either  by  requiring  a  multitude  of  different  widely 
separated  fixations  with  a  time  constraint  or  by  inducing  "tunnel  vision" 
on  one  or  two  displays.  Even  so,  measurements  reported  m  Ref.  9>  where 
parafoveal  perception  was  inhibited  by  blanking  tne  parafcveally  viewed 
display,  show  only  small  effective  time  delay  increments  (ATg)  on  the 
order  of  0.05  to  0.1 5  eec  attributable  to  scanning  as  the  parafoveal-to- 
foveal  gain  ratio  (Q)  approached  zero. 

The  switched-gain  model  has  been  quite  successful  in  modeling  behavior 
on  a  rag, in  task  in  laboratory  experiments  with  induced  natural  scanning 
between  a  primary  tracking  task  and  a  secondary  subcritical  tracking  task 
(Ref.  0),  and  on  foveal  and  parafovealiy  viewed  displays  (Refs.  14  and  17} • 

c,  A  "Reconstruction-Hold*  Model  for  Multiaxi3  Scanning.  Cons id sr 
next  an  alternate  form  of  the  model  for  the  effects  of  perception  in  scan¬ 
ning  and  sampling.  The  notion  of  intersample  extrapolation  or  reconstr action 
of  the  displayed  signals  and  their  rates  of  change  from  primarily  foveally- 
derived  samples  (still  with  possible  help  from  parafoveal  vision)  is  emphasized 
in  this  model.  Scanning  and  sampling  remains  a  quasi-random  finite-dwell 
process  with  the  additional  hypothesis  that  somewhere  in  the  mental  proces¬ 
sing  of  perceived  signals  during  the  foveal  interrupt  fraction  there  is  un 
Intersample  extrapolation  process  acting  on  retained  foveal  samples.  The 
extrapolation  process  serves  to  attenuate  the  sc  inning  remnant  at  the  expense 
of  a  small  incremental  time  de’.ay. 


y 
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One  unique  feature  of  the  "reconstruction-hold"  model  is  that  it  can 
account  for  much  larger  effective  time  delays  thar  ~an  the  ''switched -gain" 
miel.  These  delays,  still  compatible  with  scanning  behavior,  arise  in 
connection  with  extrapolation  of  samples  of  displayed  error.  The  "recon¬ 
struction-hold"  model  incorpora4 es  first-order  extrapolation  based  on 
weighted  displayed  error  rate  which  may  largely  offset  the  effective 
incremental  time  delay  accompanying  a  zero-order-hold.  The  effective 
incremental  scanning  time  delay  for  the  zero-order-hold  is  equal  to 
(Ts~Tf})/2,  or  one-half  the  average  foveal  interrupt  interval  on  the 
particular  display  of  concern.  In  contrast,  the  effective  incremental 
scanning  time  delay  for  the  first-order  extrapolation  process  with  a 
partial  .rate -weighting  coefficient,  R,  (0  <  R  <  l)  is  equal  to 
(l  —  R)(TS  —  T,j)/2,  which  can  be  made  very  small  as  R  -**■  1 .  Since  R 
cannot  be  measured  directly,  there  is  only  inferential  evidence  that  the 
pilot  may  increase  his  foveal  dwell  interval  above  0,4  sec  in  some  direct 
p’"’>ortion  to  the  desired  partial  rate-weighting  coefficient  for  recon¬ 
struction  between  foveal  fixations  (Refs.  1  and  9) • 

Another  unique  feature  of  the  "reconstruction-hold”  model  for  mu.ltiloop 
scanning  is  that  it  can  explain  a  greatly  reduced  sampling  remnant  level 
below  the  one  appropriate  for  the  "switched -gain"  model.  This  fact  is 
portrayed  graphically  for  a  single  sinusoidal  component  in  Fig.  II-7 
(from  Ref.  9)*  This  shows  the  relative  remnant  contributions  by  the 
shaded  differences  between  the  original  and  reconstructed  sinusoids.  In 
the  case  of  purely  finite  dwell  sampling  shown  in  part  c  of  Fig.  II -7, 
there  is  no  intersample  reconstruction,  no  incremental  scanning  time  delay, 
and  the  remnant  is  the  largest  as  we  would  expect.  The  gain  is  low  as  is 
evidenced  by  the  small  amplitude  of  the  describing  function  approximation 
sinusoid.  With  the  zero-order-hold  (part  d),  remnant  is  reduced,  an  incre¬ 
mental  time  delay, Atg,  is  incurred,  and  gain  is  increased.  Remnant  is 
further  reduced  and  gain  is  further  increased  by  a  first-order-hold,  and 
the  incremental  time  delay  is  reduced  (part  e).  The  remnant  here  ic  called 
processing  noise.  The  observed  half -power  frequency  of  the  normalized 
processing  noise  referred  to  the  operator’3  input  will  be  inversely  propor¬ 
tional  to  the  ratio  of  rate-to-dlsplaeement  gain  in  the  first-order 
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Figure  IX-7.  Basie  Features  of  Finite  Dvrel)  Sampling  and  Reconstruction 


extrapolator.  The  rate -to -displacement  gain  ratio  is  the  human  operator 
lead  equalization  time  constant,  T^.  The  power  spectral  density  of 
processing  noise  can  be  represented  as  shown  in  Table  II-3* 


Table  II-3 

PROCESSING  NOISE  POWER  SPECTRAL  DENSITY 


a2  •-  /  3>(o>)  do) 

O 

Definition  of  processing  remnant  power  spectral  density  for  single-axi3 
compensatory  tracking: 

%0-ile)  (of  +  t|c^)  (units)2 
n0e  rt  (1  +  Tlgifi)  rad/sec 


is  the  square  root  of  the  operator's  sampling 
interval  variance.  It  is  about  0.1  sec 

is  the  human  operator's  effective  dwell  fraction 
on  the  order  of  0.1  or  0.2  in  single-loop  tracking 
tasks 

are  the  variances  of  the  (displayed  error)  dis¬ 
placement  and  its  first  derivative  to  which  the 
human  operator  is  responding 


where 


3t. 


ne 


■I 

and 

ai 


Tr  is  the  lead  equalization  time  constant  in  sec 


A  limiting  form  of  the  "reconstruction-hold"  model  for  multiloop 
scanning  is  shown  in  Fig.  II -8  for  the  case  without  a  parafoveal  input. 

In  Fig.  II-8,  the  quasi-random  finite-dwell  foveal  sampling  process  is 
replaced  by  its  continuous  equivalent  plus  additive  sampling  and/or 
processing  noise  whose  power  spectral  density  scales  with  displayed  error 
variance.  A  simplified  equivalent  modified  crossover  model  is  shown  in 
the  accompanying  Fig.  II-9.  In  both  figures  an  additional  ’'residual" 
remnant  is  also  shown.  The  sampling-and-reconstruction  describing  func¬ 
tion  (Y^)  precedes  the  pilot's  equalization-and-actuation  describing 
function  (Yp)  in  Fig.  II-9.  Yh  consists  merely  of  an  attentuation  factor, 

Kfc  and  an  effective  incremental  sampling-and-reconstruction  time  delay  Ats: 

5 

i  *  \ 

(  I  Sarapling-ana- 

Reconstrucclon  Signal  Attenuation  Reconstruction  Delay 

Displayed  Signal 

The  values  of  K-n  and  ATg  depend  on  the  average  scanning  interval,  Ts,  the 
foveal  dwell  fraction,  R,  the  rate -weighting  coefficient,  R,  and  the  type 
of  intersample  reconstruction  weighting  function. 

The  "reconstruction-hold"  model  was  used  in  early  1967  to  make  the  pre¬ 
dictions  (shown  in  Fig.  II-3)  of  scanning  behavior  for  a  precision  instrument 
approach  in  a  Jet  transport  (Ref.  1 ) .  Although  some  evidence  for  this  model 
is  offered  in  Refs.  15  and  35,  this  model  remains  to  be  more  fully  validated. 

This  concludes  the  discussion  of  the  two  limiting  forms  of  a  multiaxis 
scanning  model  for  the  tracking  control-display  tasks. 

G.  DISHAY  DEFINITIONS 

In  addition  to  the  background  in  the  mathematical  models  which  has  been 
presented  in  the  previous  subsections,  it  is  necessary  for  an  understanding 
of  the  subsequent  sections  for  us  to  offer  some  new  definitions.  Thus,  we 
wish  to  define  the  elements  of  a  display,  the  display  content,  and  the  display 
format. 
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Figure  II-8.  "Reconstruction-Hold"  Multiaxis  Scanning  to  Compensatory 
Multiaxis  Tracking  with  One  Among  Several  Displays 


Injected  Remnant  :  Primarily  residual  and  prc  “Bsing 
noise  in  Table  II-3  by  virtue  of  intersample  reconst  action 
which  suppresses  sampling  remnant. 


Figure  II-9.  Simplified  Equivalent  '’Reconstruction-Hold"  Multi¬ 
axis  Scanning  and  Tracking  Model  for  Compensatory  Tasks. 


The  elements  of  a  display  (not  all  of  which  are  necessarily  presented) 
comprise : 

®  forcing  functions  or  command -input  signals,  i 

®  controlled  element  state  variables  or  output 
motion  signals,  m 

•  error  signals,  e  =  (i  -  m) 

®  references  or  background  , 

The  display  content  represents  the  specific  elements  which  are  prfesent 
and  which  are  either  required  for  guidance  and  control  of  a  task  or  are 
required  for  monitoring  task  performance. 

The  display  format  is  the  symbolic  code  by  which  each  member  of  the  content 
can  be  identified.  It  can  be  characterized  by  describing  the  display  in  1 
such  terms  as  separate  or  integrated,  symbolic  or  pictorial,  quickened  or 
"deadened",  as  a  flight  director  and  so  forth.  It  can  also  be  characterized 
by  describing  the  number,  size,  type,  color,  contrast  a  d  separation  of  the 
symbols . 

It  was  with  the  primary  intent  of  investigating  the  most  prominent 
effects  of  display  format  in  integrated  displays  that  the  experiments 
described  in  the  next  two  Sections  were  performed. 
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SECTION  in 

THE  SINGLE-AXIS  EXPERIMENT 


A.  PURPOSE  OP  THE  SINGLE -AXIS  EXPERIMENT 

The  purpose  of  this  set  pf  "pilot  experiments"  wis  to  establish 
baseline  describing  functions  and  levels  of  remnant  and  intern  atten¬ 
tions!  workload  under  foveal  and  parafoveal  viewing  conditions  for 

I  i 

each  of  four  different  practical  tracking  display  formats  appearing 

j  i 

individually  in  a  single -display  single-axis  cockpit  scenario.  A  plan 
of  the  experimental  design  is  presented  in  Table  IIX-1 . 

i 

Four  display  formats  were  used  in  the  first  set  of  vertical  speed 
tracking  experiments .  The  four  formats  were  1 )  a  thin  moving  luminous 
line  with  a  fixed  scale  on  a  cathode-ray  tube  (CRT),  2)  continuous 
moving  vertical  bar  with  a  fixed  scale  on  the  CRT,  3)  quantized  vertically 
moving  bar  with  fixed  scale  on  the  CRT,  4)  moving  pointer,  rotary  dial 
flight  instrument.  In  presenting  results  here,  we  shall  abbreviate  ref¬ 
erence  to  each  format  as  Line  (L),  Bar  (B),  Quantized  (Q),  and  Dial  (D), 
respectively.  The  four  formats  are  illustrated  in  Fig.  III-1 .  The 
display  formats  were  selected  from  the  survey  in  Ref.  4  to  include  stereo¬ 
types  from  past,  present  and  proposed .examples  of  instruments  and  integrated 
displays . 

The  Influence  of  display  quantization  was  Investigated  with  the  RMS 
error  comparable  to  the  displayed  quantum.  The  influence  of  parafoveal 
viewitg  angle  was  investigated  with  all  four  formats.  Two  parafoveal 
viewing  angles,  10  and  20  deg,  were  employed  during  the  training  sessions 
with  the  two  pilot  subjects.  Eye-point-of -regard  measurements  were  taken 
to  insure  that  the  subjects  maintained  parafoveal  viewing  angles  of  10  deg 
and  20  deg.  These  two  angles  were  representat .ve  of  conditions  under  which 
a  pilot  might  view  an  integrated  display  format. 

The  controlled  element,  X/s(s  2)  was  selected  for  the  extensive 
investigations  of  format  because  its  baseline  attentional  workload  is 
reasonably  high;  hence,  either  increases  or  deci eases  should  be  measurable 
without  extreme  overload Ing  or  underloading  < »  the  experiments,  and 
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c)  Quantized  CRT  d)  Rotary  Dial  Meter 


Figure  III-1  .  The  Formats  for  the 
Single -Axis  Experiments 


TABU  XXX-1 

EXPERIMENTAL  DESHflf  FOR  SDWIIS-AXIB  DISPLAY  FORMAT  EXPERIMENTS 


Independent  Variables 

Viewing  Angle  1 

0°  Foveal 

Parafoveal  1 

10° 

20° 

«t TWF"  ,CRT  Line 

(Standard) 

V 

V 

4 

"BAR"  Vertical 

Bar 

V 

4 

~T 

„  „  Rotary 

UJJUj  Dial-Pointer 

4 

4 

4 

«UAW  (14-Bars) 

with  displayed  quantum  on 
the  order  of  RM3  displayed 
error. 

4 

4 

4 

In  Each  Tested  Cell; 

2  Repli '.ations 
2  Pilot  Subjects 

TRACKING  TASK  SCENARIO  -  vide  Pig.  III-2(p.  45) 
MEASUREMENTS: 


Pilot  Describing  Functions  (e.g. ,  gain,  effective  time 
delay,  equalization) 

Serial  Segment  Remnant  Power  Spectra 

Error  Coherence  and  Signal/Noige  Ratio  in  Error 

Error  and  Error  Rate  Variance 

Mean  Error 

SPECIAL  MEASUREMENT  APPARATUS ; 

Describing  Function  Analyzer  (STl/NASA  Mark  II) 
Eye-Point-of-Regard  Instrumentation  (STl/NASA  Mark  I) 


because  it  induces  pilot  lead  qualization  at  2  rad/sec,  which  is  well 
within  the  spectrum  of  remnant  power  measurement. 

Since  the  first  set  of  experiments  vas  planned  and  executed  Jointly 
with  an  experimental  investigation  for  the  U.  S.  Air  Force  Aerospace 
Medical  Research  Laboratory  (AMRL)  of  the  effect  of  single  display  format 
on  the  character  of  single-axis  tracking  remnant,  the  reader  interested 
in  the  full  details  of  the  experimental  design  may  refer  to  Ref.  19 .  We 
shall  summarize  here  only  those  results  which  have  a  bearing  upon  a  theory 
for  integrated  display  format. 

B.  SCENARIO 

A  single-axis  tracking  task  vas  both  necessary  and  desirable  in  order 
to  keep  the  experiment  simple  and  economical,  but  we  wanted  to  create  an 
aircraft  piloting  scenario  having  more  face  validity  than  the  usual 
laboratory  tracking  task  in  an  arm  chair.  To  achieve  Borne  degree  of 
validity,  we  employed  actual  experienced  pilots  as  subjects  in  a  fixed- 
base  aircraft  cockpit  with  a  center  stick  for  pitch-axis  tracking. 

C.  SIMULATION 

The  apparatus  included: 

1 .  A  modified  fighter  aircraft  cockpit,  with  center  stick 
and  instrument  panel. 

2.  An  analog  computer  to  provide  the  controlled  element 
dynamics,  display  signal  processing,  and  some  perform¬ 
ance  measurement  capability. 

3.  A  Describing  Function  Analyzer  that  provided  the  input 
disturbance  to  the  simulation  while  simultaneously  pro¬ 
cessing  data  from  which  dynamic  response  and  remnant 
measurements  were  obtained. 

4.  The  Eye -Point -Of -Regard  measurement  apparatus. 

These  are  described  in  more  detail  below. 

1 .  Cockpit 

The  STI  fixed-base  fighter  cockpit  facility  was  used.  It  included 
the  standard  seat  and  center  stick  and  a  special-purpose  instrument  panel, 
described  later.  The  stick  had  negligible  friction  and  viscous  damping, 
and  a  force  gradient  of  approximately  15  Newtons/cm  (8.6  lb/in.).  The 
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instrument  panel  was  approximately  57  cm  (23  in.)  from  the  pilot's  eye, 
so  that  1  cm  of  display  travel  on  the  panel  equalled  1  deg  of  visual  arc. 

The  stick  grip  center  position  was  17  cm  ait  of  the  instrument  panel  plane 
and  25  cm  below  the  pilot's  horizontal  line  of  sight. 

2.  Displays  and  Viewing  Conditions 

Two  basic  display  devices  were  used:  (a)  a  low  persistence  5  in. 

CUT,  and  (b)  a  rotary  dial  meter.  The  CRT  was  used  to  present  the  three 
vertical  movement  display  formats  shown  in  Pig.  I1I-1 .  These  included: 

a.  A  thin  horizontal  LINE,  10  cm  in  length  a ad  0.1  cm  thick. 

There  were  no  dynamic  lags  in  this  display 

b.  A  VERTICAL  BAR  format  0.5  cm  in  width  extending  from 
the  bottom  edge  of  the  CRT  as  shown  in  Pig.  Ill-lb.  The 
height  of  the  bar  relative  to  the  CRT  reference  line 
represented  the  tracking  error. 

c.  A  QUANTIZED  format  consisting  of  a  luminous  horizontal 
bar  1 .5  cm  long  and  0.25  cm  thick  that  moved  in  0.25  cm 
vertical  steps.  Fourteen  segments  (seven  above  and  below 
null)  were  available  but  were  seldom  used.  The  quantiza¬ 
tion  logic  for  this  display  was  mechanized  using  comparators 
with  millisecond  switching  times. 

To  eliminate  subjective  brightness  of  the  various  formats  as  a  con¬ 
founding  experimental  variable,  each  pilot  was  asked  to  adjust  the  CRT 
brightness  control  such  that  a  particular  CRT  format  gave  the  same  "apparent 
brightness"  as  the  adjacent  rotary  dial's  mechanical  pointer. 

The  CRT  display/stick  relationship  was  such  that  moving  the  stick 
forward  caused  the  CRT  mark  to  move  up.  This  relationship  is  consistent 
with  aircraft  gunnery  tracking  and  with  conventional  artifical  horizon 
instruments  ("inside  out"  view). 

The  rotary  DIAL  meter  shown  in  Fig.  Ill-Id  was  an  aircraft  instrument 
quality  voltmeter  (galvanometric  movement  drive).  The  pointer  was  3  cm 
in  length  and  0.25  cm  thick.  The  basic  response  of  the  meter  was  second- 
order  with  a  natural  frequency  of  1  Hz  and  a  damping  ratio  of  O.35.  This 
response  was  too  sluggish  for  the  purposes  of  this  experiment,  so  the 
meter  was  compensated  to  provide  a  flat  response  over  the  input  bandwidth. 
For  small  angles,  the  meter  sensitivity  was  scaled  to  give  arc  length 
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deflections  at  the  needle  point  equal  to  vertical  deflections  on  the  CRT 
for  corresponding  error  signals. 

3*  Controlled  Element  Dynamics  and  Input 

The  controlled  element  dynamics ,  K/s(c  +  2)  were  selected  as  being 
intermediate  in  leed  equalization  required  of  the  pilot  (Tl  »  0.5  to  1.0  sec). 
The  dynamics  were  mechanized  on  an  EAI  231 R  computer. 

The  input  was  a  sum  of  five  randomly  phased  sine  waves  with  amplitudes 
inversely  proportional  to  frequency.  To  produce  roughly  equal  RMS  displayed 
signals,  the  input  RMS  amplitude  was  set  at  0.75  cm.  This  resulted  in  RM3 
errors  on  the  order  of  O.3-O.5  cm.  The  input  frequencies  were  approximately 
equally  spaced  logarithmically  and  span  the  frequency  range  important  for 
human  operator  dynamic  response  measurements  (i.e.,  0.5-10  rad/sec).  The 
sine  waves  were  generated  by  the  Describing  Function  Analyzer.  The  input 
spectral  shaping  and  frequency  spread  was  designed  to  give  display 
motions  subjectively  equivalent  to  gust  disturbances  in  an  airplane,  to 
allow  accurate  measurement  of  pilot  dynamic  response  and  remnant  behavior, 
and  to  avoid  excessively  high  displayed  signal  peaks  during  adverse  display 
viewing  conditions. 

4.  The  Describing  Function  Analyzer 

An  electromechanical  Fourier  analyzer,  STl/NASA  Mk  II  Describing 
Function  Analyzer  (DFA),  was  used  to  obtain  dynamic  response  measurements. 

A  thorough  description  of  the  measurement  technique  and  functional  mech¬ 
anization  is  given  in  Ref.  20.  Basically,  the  analyzer  generates  a  sum-of- 
3inusoids  input  which  is  provided  to  the  tracking  loop  as  shown  in  Fig.  Ill -2, 
and  computes  the  Fourier  transform  of  the  system  error  signal  at  each  of  the 
input  sine  wave  frequencies,  referred  to  each  component  sinusoid. 

5.  Eye-Point-of -Regard  (EPR) 

The  EPR  equipment  consisted  of  three  units:  l)  spectacle  frame-mounted 
transducers  and  associated  electronics  for  measuring  eye  angle  with  respect 
to  the  head;  2)  a  goniometer  gripped  in  the  mouth  for  measuring  head  angles 
with  respect  to  the  display  panel;  3)  a  special  purpose  analog  computer  for 
combining  the  head  and  eye  angles  to  give  voltage  signals  proportional  to 
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Figure  III-2 .  Tracking  Tasks,  Data  Measurements  and  Analysj.3 


the  eye-point-of -regard  on  the  display  panel.  This  system  is  more  fully 
described  in  Ref.  21  . 

D.  JSASUHEKHSTS 


The  fashion  in  which  the  performance  measures  ana  describing  function 
parameters  were  obtained  is  illustrated  in  Fig.  Ill -2.  The  describing 
functio-n  analyzer  generates  a  sum  of  sine  waves  which  is  the  input  to  the 
tracking  loop.  From  the  loop  tracking  error  signal,  it  computes  the 
Fourier  coefficients  at  each  frequency  present  in  the  i’.p^t.  The  corres¬ 
ponding  input-referenced  Fourier  transform  of  the  input  is  known  a  priori , 
so  that  the  err or-to- input  transform  ratio  or  describing  function, 

E(  j©)/l(  ja>) ,  can  be  computed.  Given  this  describing  function,  it  is  a 
simple  matter  to  compute  the  open-loop  and  closed-loop  descr icing  functions 
using  the  vector  relationships: 


(open- loop  DF) 
(closed-loop  DF) 


Since  the  controlled  element,  is  known  (and  calibrated),  the  pilot 

describing  function  can  be  computed  as  well: 


■  K  •  V<*> 

A  time  shared  computer  system  (Tyrashare)  was  used  to  reduce  the  analyzer 
data.  In  addition  to  describing  function  and  performance  measure  calcula¬ 
tions,  the  program  also  included  interpolation  and  curve  fitting  routines 
to  interpolate  (between  adjacent  frequency  points)  the  extended  crossover 
model  properties  s  :h  as  open-loop  gain  and  phase  crossover  frequencies 
(«>cc>  *%c)>  Phase  margin  (Tn^);  and  equivalent  operator  time  delay  (Te0)« 

See  Ref.  19,  Appendix  B,  for  the  mathematical  details.  The  other  important 
parameter,  the  parafoveal  to  foveal  gain  ratio,  Q,  was  computed  from  the 
describing  function  parameters  as  described  above  in  Section  II. 

In  addition  to  E(  jeo)  the  DFA  computes  the  integral  squared  value  of 
system  error  and  thi  mean  valve  of  error.  These  data  wer°  used  io  calculate 


the  variance  of  error,  =  e2  —  (e)1".  Most  relevant  to  tracking  tests 
is  the  normalized  tracking  error,  cr^/c^.  Error  rate  variance  was  also 
measured.  The  DFA  further  yielded  data  giving  the  input-coherent  error 
variance,  ae^,  and  this  permitted  computation  of  the  important  remnant 
er^or  pover,  0^2  =  o|  —  ae 2.  A  final  measure  of  overall  error  performance 
was  the  error  coherence,  p^,  which  is  the  ratio  of  ir.put-conerent  error 
variance  to  total  error  variance.  The  various  relationships  of  interest 
here  are: 


Error  coherence:  p|  1  ce2/crf 

Relative  remnant  pover  fraction  in  error: 


aeH/al 


Signal/noise  ratio  in  error  signal:  ^ 


E.  SUBJECTS 


1  ~  °§ 


Two  pilots  were  selected  to  participate  in  this  study.  Both  pilots 
had  extensive  flight  experience.  A  resume  of  their  experience  is  given  in 
Table  HI-2. 

TABLE  XH-? 

PILOT  BACKGROUND 


Aeronautical 

Ratings 


Total  Flight 
Hours 


Hours  By 
Duty 


Hours  By 
Aircraft 


Inst rumen  i 
Hour  3 


Pilot  1  (RH)  0 

Pilot  2  (DH)0 

Airline  transport  pilot 
Flight  instructor 

Military  transport  pilot 

5150 

2130 

Student,  150 

First  Pilot,  1000 
Instructor ,  2000 

Student,  260 

Copilot,  570 

First  Pilot,  1260 
Instructor,  90 

2650  Single  Engine; 

500  Multi -Engine  (All 
Light  Aircraft) 

550  High  Perf.  Jet; 

920  Piston  Engine  Trans  - 
port,  n  Rise. 

200 

275 

TR 


F.  IMPORTANT  RESULTS  OF  THE  SINGLE -AXIS  EXPERIMENTS  WITH  DIFFERENT  DISPLAY 

FORMATS 

The  principal  reduced  experimental  results  are  summarized  concisely  in 
Figs.  HI-3,  and  5.  Each  graph  presents  foveal  results  on  the  left  side 
and  parafoveal  results  in  the  center  and  on  the  right  side.  Each  figure 
includes  results  for  the  Line,  Bar,  Dial  and  Quant(ized)  format  in  that  order 
from  left  to  right.  The  results  for  each  pilot's  tracking  run  are  coded 
symbolically  in  the  legend  on  each  figure.  Replications  are  tagged.  The 
20  deg  parafoveal  results  are  training  data. 

In  Fig.  III-3  both  pilot-subjects  in  these  single-axis  experiments 
exhibited  an  incremental  effective  time  delay  with  the  Quantized  format 
on  the  order  of  l/lO  sec  more  than  that  delay  (about  l/4  sec)  with  the  other 
formats  under  foveal  viewing  conditions.  Since  quantization  alone  will  not 
produce  the  increase  in  delay,  whereas  interned  reconstruction  or  extra¬ 
polation  and  smoothing  among  quanta  to  derive  rates  of  change  can  produce 
the  observed  increase  in  delay,  the  effect  would  seem  to  be  perceptual. 

This  result  is  relevant  for  raster-scanned  displays. 

Smaller  average  Increases  in  effective  time  delay  on  the  order  of  l/20 
sec  resulted  for  the  Line,  i>ar  and  Dial,  formats  between  foveal  and  para¬ 
foveal.  viewing.  Thia  small  time  delay  increment  is  consistent  with  values 
observed  while  tracking  with  the  Line  format  in  previous  experiments.  It 
may  be  "explained"  by  association  with  the  differential  difference  extra¬ 
polation  model  for  higher  frequency  lead  generation  (Ref.  22).  One  pilot 
subject  exhibited  a  further  increment  in  time  delay  of  between  O.15  Bind 
0.20  see  under  20°  parafoveal  viewing  conditions. 

The  results  under  parafoveal  viewing  conditions  are  particularly 
relevant  to  a  theory  of  integrated  diBplay  format.  Those  formats  which 
Induce  marked  changes  In  behavioral  properties,  coherence,  or  error  scores 
between  foveal  and  parafoveal  viewing  conditions  would  sewn  to  be  inferior 
candidates  for  an  integrated  display  application  with  respect  wo  those 
formats  which  Induce  few  and/or  losaer  changes. 

Thme  single-axis  baseline  results  offer  no  clear  distinction  in  measures 
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Pilots  :  O  =  RH  ,  □  =  DH  ;  Replications  =  Tagged 
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Controlled  Element  Y 


of  behavior,  coherence,  or  error  scores  between  foveal  and  parafoveal  track¬ 
ing  with  the  Line  and  Dial  formats.  With  both  Line  and  Dial  formats, 
however,  measures  of  behavior,  coherence  and  error  scores  deteriorated 
relatively  more  at  20  deg  than  at  a  1 0  deg  paraf oveal  'viewing  angle .  For 
example,  a  display  designer  might  be  impelled  to  increase  the  field  of  view 
of  an  integrated  display  format  to  improve  the  pilot'd  basis  for  monitoring 
the  situation.  Alternatively,  the  designer  might  want  to  increase  the 
displayed  field  of  view  to  reduce  foveal  clutter  among  symbols  in  a  dense 
format,  if  the  content  must  be  preserved  and  the  field  of  view  scaling  does 
not  otherwise  have  to  be  in  the  ratio  1:1  with  the  real  world.  However,  the 

I 

results  of  the  single-axis  experiment  imply  that  increasing  the  field  of 
view  of  an  integrated  display  format  greater  than  about  10  deg  will  produce 
diminishing  returns  through  the  relatively  greater  deterioration  of  para¬ 
foveal  tracking  ability. 

The  only  format  for  which  the  single-axis  baseline  results  offer  consistent 
evidence  of  inferior  suitability  is  the  Bar.  This  is  exemplified  by  a  rather 
large  reduction  in  average  parafoveal  gain  at  10  deg  in  Fig.  IH-b  and  by 
consistent  increases  in  relative  and  absolute  remnant  power  and  total  error 
variance.  The  results  for  relative  remnant  and  error  coherence  Eire  shown 
in  Fig.  III-5.  The  Bar  format  was  found  to  be  unusable  for  tracking  at  a 
20  deg  peiraf oveal  viewing  angle.  It  should  be  emphasized  that  these  prelimin¬ 
ary  results  suggest  inferiority  of  the  Bar  format  under  parafoveal  viewing 
conditions  only  in  a  closed-loop  tracking  context.  ' 

Qualitative  analysis  of  these  single-axis  experiments  and  several  past 
experiments  shows  that  many  of  the  parafoveal  viewing  effects  (e.g.,  relatively 
greater  higher  frequency  gain,  relatively  less  low  frequency  phase  leig, 
increased  normalized  injected  remnant  power,  etc.  could  be  "e^pl^ined"  by  an 
increase  in  the  displacement  perception  threshold  relative  to  the  rate 
perception  threshold  under  paraf o'veri  viewing  conditions.  A  model  of  this 
effect,  however,  remains  to  be  validated. 
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'  specie®  rv 

AN  EXPLORATORY  1SJLTIA3CIS  DTOIRATED 
DISPLAY  EXPERIMENT 

I 

I  '  i 

A.  PURPOSE  OP  THE  mJHMIS  EXPERIMENTS  WITH  DIFFERENT  DISPLAY  FORMATS 

i  i 

As  indicated  in  Appendix  A,  the  arrangement  of  information  displayed  to 
a  pilot  can  have  major  effects  on  the  pilot-vehicle  system  performance  (in 
terms  of  dynamic  response  and  injected  noise)  and  on  pilot  workload,  in 
terms1 of  the  pilot's  excess  available  capacity  for  handling  other  tasks  such 
as  emergency  situations  as  well  as  the  psychological  stress  level  associated 
with  the  task.  The  preliminary i experiment  discussed  here  is  an  attempt  to 
develop  and  test  a  variety  of  quantitative  techniques  for  measuring  the 
above  effects  in  conjunction  with  integrated  display  formats.  In  addition, 
we  hoped  to  quantify  some  of  the  characteristics  of  display  integration  to 

i 

guide  future  display  research,  development  and  design.  We  wished  to  quantify 
a  definition  for  an  "integrated"1  display  in  terms  of  measurable  (and  pre¬ 
dictable)  properties  of  format  and  content .  which  are  related  to  the  pilot's 
workload  in  a  realistic  cockpit  scenario.  Table  IV-1  outlines  the  experimental 
design.  T^e  plan  and  procedure  for  the  multiaxis  experiment  will  be  presented 
next.  Tliis  is  followed  by  a  discussion  of  the  results  which  were  obtained. 

B,  SCENARIO 

In  this  experiment,  we  attempted  to  set  up  as  simple  a  stimulation  as  pos¬ 
sible  and  yet  achieve  an  operational  relevance  that  would  be  motivating  to 
pilots  and  which  would  provide  results  that  could  be  extrapolated  to  more 
complex  simulations  and  operational  situations.  A  helicopter  formation 
flying  task  was  chosen  that  required  both  cyclic  and  collective  control. 

The  pilot's  primary  task  was  to  control  the  longitudinal  displacement  errors 
of  his  ship  from  a  commanded  position  behind  a  manuevering  lead  aircraft. 

It  was  in  this  task  that  the  differen+  display  formats  described  below  were 
evaluated. 

The  lateral  cyclic  and  collective  control  tasks  were  somewhat  abstract 
in  that  they  were  uncoupled  from  each  other  and  the  primary  task  (so  as  to  sim¬ 
plify  the  measurement  of  desciiblng  functions).  The  vehicle  response  to 
control  inputs,  however,  was  judged  to  be  realist!-, .  The  lateral  task  was 
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to  maintain  a  level  roll  attitude  with  slightly  unstable  roll  response,  and 
the  collective  task  was  to  maintain  a  command  altitude,  again  with  slightly 
divergent  dynamics. 

The  lateral  and  collective  control  tasks  were  used  to  represent  the 
combined  workload  a  pilot  might  encounter  in  an  operational  situation  when 
combined  with  the  longitudinal  task.  The  lateral  cyclic  and  collective 
control  tasks  might  be  viewed  in  the  terms  of  experimental  psychology  as 
classical  subsidiary  or  secondary  tasks.  See  Knowles  (Ref.  £?5)*  Then  the 
workload  demand  is  a  direct  function  of  the  level  of  instability  of  the  dynamics 
(Ref.  This  technique  has  been  used  very  successfully  in  the  past  (Refs.  9t  25)* 

It  is  relevant  tc  vehicle  control  simulations  which  mainly  involve  continuous 
control  tasks. 

C.  SIMULATION 

The  simulation  consisted  of  a  cockpit  with  display  panel  and  control  to¬ 
gether  with  an  analog  computer  which  was  used  to  mechanize  the  control  task 
dynamics.  Additional  measurement  equipment  included  a  Describing  Function 
Analyzer  (''FA)  which  was  used  for  dynamic  response  measurements,  and  an 
Eye -Point-of -Regard  (EPF)  system  for  measuring  the  pilot's  eye  movements. 

1 .  Control  Tasks  and  Dynamics 

a.  Primary  Task.  The  pilot-subjects'  primary  task  was  to  control  longi¬ 
tudinal  position  deviations  of  his  aircraft  from  a  commanded  position  behind 
a  raanueverlng  lead  aircraft.  A  compensatory  display  was  used  so  that  the 
pilot  was  aware  only  of  his  deviation  from  the  commanded  position.  The  simu¬ 
lated  formation  was  moving  at  an  average  forward  speed  of  60  knots,  which 
set  the  flight  condition  for  the  longitudinal  control  dynamics,  but  random 
commanded  speed  variations  occurred  in  the  control  loop  because  of  the  pre¬ 
sumed  manuevering  of  the  lead  aircraft. 

A  block  diagram  of  the  above  described  task  is  shown  in  Fig.  IV-1 .  The 
Describing  Function  Analyzer  (DFA)^  was  used  to  &.nerate  tne  commanded  velocity  (uc) 


*An  Electromechanical  Fourier  Analyzer  developed  for  the  NASA -Ames  Rosear'h 
Center.  The  measurement  theory  upon  which  this  device  is  based  is  give.-i  in 
Ref.  20, 
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input  to  the  control  loop,  as  well  as  to  analyze  the  resulting  velocity  error 
(ug)  so  as  to  give  measures  of  system  stability  and  bandwidth. 

The  command  velocity  input  was  a  sum  of  sinusoids  as  described  in 
Table  IV-  2.  The  input  appeared  random  to  the  pilot  and  allowed  dynamic 
response  measurements  to  be  made  at  each  of  the  input  frequencies  which 
spanned  the  range  from  0.2  to  6.3  rad/sec. 

The  pilot  was  displayed  information  on  pitch  attitude  and  combinations 
of  position  and  velocity  error  (xe,  Ug)  as  explained  below  in  connection 
with  the  description  of  the  actual  display  formats  which  were  employed  in 
the  experiments. 

The  pilot  controlled  longitudinal  vehicle  motions  by  commanding  pitch 
attitude  changes  with  fore-aft  motions  of  a  center* mounted  cyclic  stick. 

The  displacement  and  force  gradients  are  described  in  Figure  TV-2. 

The  longitudinal  control  dynamics  were  mechanized  as  a  linear,  two  degree 
of  freedom  set  of  motion  equations  given  in  Table  IV- 3.  Stability  deriva¬ 
tives  which  were  used  corresponded  to  the  dynamics  of  the  CH-53  single  rotor 
helicopter  as  analyzed  In  Ref.  2  .  The  basic  vehicle  dynamics  are  unstable, 
and  a  simulated  automatic  flight  control  system  (AFCS)  was  provided  to 
stabilize  vehicle  attitude. 

The  AFCS  was  employed  in  two  different  modes  so  as  to  give  the  two  sets 
of  dynemics  shown  in  Fig.  IV  -  3«  In  the  first  case,  velocity  feedback  was 
employed  in  addition  to  pitch  attitude.  In  the  frequency  range  below  1  rad/sec, 
pitch  attitude  response  was  approximately  the  derivative  of  the  stick  input, 
and  longitudinal  position  response  was  approximately  the  integral  of  stick 
inputs.  These  dynamics  amount  to  the  rate  dynamics  used  in  classical  tracking 
research  (Ref.  26).  Appropriate  pilot  behavior  in  this  case  (as  shown  in 
Ref.  10)  is  to  make  control  defections  proportional  to  displayed  position 
errors  (xe).  Some  lead  equalization  might  be  helpful  for  these  dynamics  in 
the  neighborhood  of  one  rad/sec  but  no  low  frequency  lead  is  required  within 
the  practical  closed-loop  bandwidth  of  the  system  (less  than  1  rad/sec). 

The  second  AFCS  mode  included  pitch  rate  along  with  pitch  attitude  feedback. 
This  is  equivalent  to  the  CH-53  operational  configuration.  This  system  gives 
a  pitch  response  comparable  to  a  first  order  lag  (low  pass  filter)  with  a  break 
frequency  at  about  2  rad/sec.  It  amounts  to  a  "pitch  command"  system  where 
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PRIMARY  LONGITUDINAL 


u  Feedback  K§e  =.28  rad  (8!) /inch 
6  Feedback  Kge  =.05Srcd  (Bl)/inch 
Force  Gradient  =  2.5N/cm 


SECONDARY  LATERAL 

» i^— w  ■  . . . . . 


22  in. 


Sa 


Kn  =26.4 


deg/sec 


inch 

Force  Gradient  =  2.5  N  /cm 


Tr  =  .2  sec 


X^=  J,.2  rad /sec 


SECONDARY  COLLECTIVE 


lgur.»  IV  ;  .  Tho  Tasks  Tor  iho  Multiaxis  Kxp-rimant. 


ulrad/fc} 
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TABIE  rsr-2.  COMMAND  VELOCITY  INPUT 


5 

uc  =  sin(cOjt  +  <Pj_) 

i=1 


Sinusoid 

Frequency 

(rad/sec) 

Amplitude 

(ft/sec) 

1 

O.188 

2 

O.5O3 

3 

1 .26 

0.1  | 

1 

4 

3.02 

5 

6.28 

■ 

ac  =  O.389  ft/sec 

cp^  randomly  phased  from  run  to  run 


2*BK  17-5  •  HELI00H2R  SUaJLAHOS  EQUATIONS  OF  MMM 


Matrix 


■s  -  Xa  -XqS  *  g  -j 

_-Mu  s2  -  +  M3  j 


Stability  Derivatives 


=  -.057 

-1 

sec 

My  «  .003 

ft" 

=  2.85 

ft/sec 

Mq  =  -062 

sec 

XB, 

g 

=  32-5 

ft/sec2 

\  »  -*.55 

sec 

=  32.2 

ft/seo2 

•M 
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pitch  attitude  is  proportional  to  stick  deflection.  The  resulting  position 
response  to  stick  inputs  is  equivalent  to  acceleration  dynamics  used  in 
classical  tracking  research  (Ref.  26).  They  require  the  pilot  to  make  stick 
deflections  proportional  to  the  derivative  or  rate  of  change  of  the  displayed 
position  error  (x«)>  (Vide  Ref.  10.)  In  this  case  it  was  very  helpful  to 
provide  displayed  lead  equalization  such  as  with  a  flight  director,  or  to 
display  velocity  error  (ue)  explicitly. 

b.  Secondary  Teaks.  The  pilot  was  required  to  maintain  a  level  roll 
attitude  and  a  commanded  altitude  with  the  dynamics  shown  in  Fig.  IV-  4  as 
secondary  tasks.  The  roll  dynamics  included  a  roll  time  constant  of  0.2 
sec  and  a  small  spiral  divergence  or  instability.  The  collective  control 
was  used  to  maintain  a  commanded  altitude  through  dynamics  which  included  a 
flight  path  response  time  constant  of  1.4  sec  and  a  slow  divergence.  Both 
altitude  error  (from  the  commanded  altitude)  and  rate  of  climb  were  displayed 
to  the  pilot  on  vertical  meter  movements  placed  side  by  side. 

Pilot  Induced  noise  or  remnant  was  sufficient  to  excite  the  unstable 
dynamics,  so  disturbance  inputs  were  not  required  for  the  secondary  tasks. 

The  level  of  instability  was  used  to  control  the  attentional  demand  or  workload 
on  the  pilot.  As  shown  in  Fig.  IV  -  3  two  levels  of  instability  were  selected 
which  respectively  corresponded  to  low  and  high  workload  demands  on  the  basis 
of  the  pilot's  subjective  opinions.  Previous  research  (Refo.  2%  27,  and  28 ) 
has  shown  that  high  workload  demands  on  the  pilot  tend  to  accentuate  observable 
effects  of  differences  in  primary  task  variables.  This  was  also  found  to  be 
the  case  in  the  present  research  and  the  phenomenon  was  used  very  effectively 
in  evaluating  different  display  formats. 

c.  Cross  adaptive  Workload  Task.  A  scheme  employed  by  McDonnell  (Ref.  25  ) 
was  used  here  to  quantify  the  workload  demands  of  various  display  formats. 

This  technique  involved  a  variation  of  the  above  described  tasks  where  the 
pilot  was  only  controlling  the  longitudinal  axis  and  stabilizing  roll  attitude. 
The  variation  was  such  that  the  divergence  time  constant  of  the  roll  axis 
dynamics  was  adaptively  adjusted  as  a  function  of  primary  task  performance. 

The  adaptive  adjustment  scheme  is  shown  in  Fig.  IV -5. 

The  performance  measure  was  the  absolute  value  of  the  sum  of  position  and 
velocity  errors  (xg,  tig).  When  this  measure  exceeds  the  error  criterion,  the 
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roll  task  divergence  decreases,  and  when  the  performance  is  below  the  criterion 
value  the  divergence  increases.  The  error  criterion  was  adjusted  to  be 
nominally  25$  above  the  performance  achieved  during  a  preceeding  period  of 
steady  state  tracking.  (The  same  DFA  input  was  used  in  both  cases.) 

The  amount  by  which  the  roll  divergence  parameter,  Xqj,  increases  over 
the  steady  state  trial  i3  directly  related  to  the  increased  workload  which 
the  pilot  can  tolerate  on  the  side  task  for  a  25$  increase  in  error  on  the 
primary  task.  Presumably  this  increased  workload  will  vary  according  to  the 
experimental  condition  in  the  main  task,  such  as,  for  example,  the  display 
format.  Thus,  the  adapted  X<p  will  give  a  quantitative  measure  of  the  allow¬ 
able  excess  workload  a  pilot  can  tolerate  for  a  given  display  format.  The 
optimum  display  format  is  the  one  which  yields  the  most  excess  capacity. 

2 .  Displays 

The  configuration  of  the  cockpit  display  panel  is  shown  in  Fig.  IV  -5. 

The  viewing  distance  to  the  panel  was  approximately  51  in.  The  CRT  presented 
an  artificial  horizon  for  pitch  and  roll  attitude  information  as  well  as  the 
longitudinal  display  formats  described  below.  The  collective  control  (altitude 
hold)  task  utilized  the  two  vertical  edge  meters  mounted  to  the  left  of  the 
CRT.  The  altimeter  and  airspeed  indicator  were  provided  for  status  information, 
but  they  did  not  provide  useful  control  information  because  of  their  relatively 
insensitive  scaling. 

The  primary  task  display  formats  presented  on  the  CRT  are  shown  in  Fig.  IV-  6. 
The  state  format  gave  longitudinal  position  error  only.  Velocity  error  infor¬ 
mation  was  added  in  the  state  +  rate  format  so  as  to  aid  in  the  rate  or  lead 
equilization  required  of  the  pilot  in  the  primary  task.  As  noted- in  Fig.  IV  -  6 
the  ue  scaling  was  proportioned  to  the  lead  required.  Finally,  the  flight  direc¬ 
tor  configuration  gave  a  stick  command  signal  which  the  pilot  could  track  with 
stick  deflections  proportional  to  display  deflections.  The  flight  director 
equation  took  into  account  the  equalization  required  for  the  longitudinal 
dynamics.  Figure  IV -  6  gives  the  display  gains  which  were  used  including 
the  various  flight  director  equations  tested. 

D.  MEASUREMENTS  AND  PROCEDURES 

A  variety  of  measurements  were  performed  both  to  investigate  various 
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CATHODE  RAY  DISPLAY  FORMATS 


Display 

Scaling 

Flight  Director  Equations 

Position 

Error,  xe 

4  ft/ln. 

Velocity 
Error,  ue 
4Tl  ft /in. 

Velocity  AFCS 

ro  =  .25(xe  +  Tl^)  ^/in. 

Pitch  Rate 

and  Attitude 

AFCS 

ID  =  ,125(xe  +  T^Ug  +  200)  ft/in. 

FD1  =  .025(xe  +  TLUg  +  1009)  ft/in. 
FD2  a  .025(xe  +  TjjUe  +  508)  i ft/in. 

Figure  IV-6.  Cockpit  Display  Panel  Configuration, 

Primary  Task  CRT  Display  Formats  and  Scaling 
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techniques  for  evaluating  displays,  as  veil  as  to  .obtain  comprehensive  data 
on  a  range  of^  display  formats,  The  measurements  are  divided  into  performance 
and  describing  function  measures  obtained  during  steady  tracking  tasks,  eye- 

i 

point-of -regard  obtained  during. these  same  tasks,  pilot  opinion  ratings 
obtained  at  tha  end  of  the  tracking  runs,  and  excess  workload  capacity  as 
ipeasured  by  the  instability  score  obtained  during  the  cross  adaptive  task. 

1 .  Performance  and  describing  Function  Measurements 

f 

During  the  steady  state  tracking  tasks  the  pilots  were  instructed  to 
minimize  ilongitudinal  position  deviations  caused  by  the  command  velocity 
generated  by  th^  UFA  (Fig.  IV  - 1 ).  After  a  warm  up  period  to  allow  the  pilot 
to  reach  steady  state1,  data  were1  measured  over  a  100  second  period.  Mean  and 

:  i  ,  ' 

mean-squared  measures  of  a  variety  of  variables  associated  with  both  the 
primary  and|  secondary  tasks  vei'e  obtained  on  the  analog  computer.  These  data 
were  then  further  reduced  off  line  to  give  RMS  values.  The  DFA  computed 

i 

|  Fourier  coefficients, and ‘additional  performance  measures  during  the  measure¬ 
ment  period,  and  these  data  vei'e  also  further  reduced  off  line  to  yield  the 
1  pilots’  describing  functions,  remnant,  and  describing  function  fitting  para¬ 
meters  related  to  primary  task  bandwidth.  (These  were  crossover  frequency, 
o\,,  and  stability  in  the  sense  of;  the  phase  margin,  Cfo. ) 

,  I 

2.  Eye-Point -of -Regard  (EFR) 

•  i 

The  display  arrangement  (Fig.  IV  -6)  required  scanning  between  the  CRT 

l 

and  the  collective  control  task  displays.  It  was  desired  to  measure  the 
amount  of  time  spent  viewing  each  display  and  the  rate  of  scanning  between 
displays  as  well  as  to  see  if  the  different  longitudinal  display  formats 
caused 'differences  in  these  statistics.1  It  was  also  desired  to  see  if  the 
1  different  display  formats  might  cause  scanning  among  the  elements  of  the  display 

i 

on  the  CRT.  1 

1  *  j 

The  EPR  equipment  consisted  of  three  units:  l)  spectacle  frame-mounted 
transducers  and  associated  electronics  for  measuring  eye  angle  with  respect 
, to  the  head;  2)  a  goniometer  gripped  in  the  mouth  for  measuring  head  angles 
with  respect  to ' the  display  peuael;  3)  a  s|pecial  purpose  analog  computer  for 
combining  the  head  and  eye  angles  to  give  voltage  signals  proportional  to 
the  eye -point-of -regard  on  the  display  panel.  This  system  is  more  fully 

,  i . 
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described  in  Ref,  31 .  In  the  experiment  described  here  we  only  measured 
horizontal  eye  movements.  This  was  because  we  were  primarily  Interested  in 
scanning  between  the  collective  side  task  displays  and  the  CRT. 

3*  Pilot  Opinion  Ratings 

At  the  end  of  each  tracking  run  the  pilot  was  asked  to  record  his  sub¬ 
jective  opinion  of  various  display  qualities  on  the  questionnaires  given  in 
Table  IV  -4.  The  pilot  recorded  his  opinion  by  making  a  mark  on  the  rignt 
hand  edge  of  the  scale  assuming  it  to  be  a  continuum. 

The  scales  were  designed  according  to  recent  ideas  on  psychophysical  scal¬ 
ing  of  aircraft  handling  qualities.  (Vide  Appendix  C  and  Ref.  23.)  The  scales 
were  designed  tc  measure  a  broader  range  of  effects  than  were  tested  in  these 
multiaxis  experiments.  The  approach  here  was  to  partition  display  factors  into 
several  dimensions,  In  order  to  obtain  a  more  comprehensive  measure  of  display 
acceptability  than  might  have  been  obtained  from  a  single  rating. 

4.  Cross  Adaptive  Excess  Control  Capacity  Measurement 

The  cross  adaptive  task  described  above  was  performed  on  each  display 
format  after  the  steady  tracking  run.  The  roll  divergence  parameter  ( Xq>)  was 
started  at  0.1  rad/sec  and  was  held  steady  at  the  beginning  of  the  run  to 
obtain  a  steady  state  measure  of  performance.  The  error  criterion  was  then 
reset  2%  greater  and  the  adaptive  adjustment  of  commenced.  The  adaptive 
rate  T.C a  (see  Fig.  IV -5)  wa^  set  to  obtain  a  rapid,  stable  adaptation.  The 
run  was  allowed  to  continue  either  until  the  pilot  lost  control  or  until  X,p 
settled  out  at  a  stable  level.  The  X^  occurring  at  loss  of  control  or  the 
filial*  stable  level  were  then  recorded  as  a  measure  of  the  pilot's  excess 
control  capacity  for  a  given  display  format. 

E.  SUBJECTS 

TVo  experienced  Air  Force  test  pilots,  one  with  considerable  helicopter 
experience,  were  employed  as  subjects.  Their  background  and  flying  experience 
are  summarised  in  Table  IV -3 . 


Table  XV-5.  Pilot  Background  and  Experience 


Pilot 

Background 

Flight  Time 

and  Age 

Total 

Instruments 

V/STOL 

PB 

58  Yr. 

Experimental 

Helicopter  Flight  Test; 
Opinion  Rating  of 

Flying  Qualities 

590Q 

650 

4000 

FP 

32  Yr. 

Aerospace  Research  and 
Experimental  Flight  Test] 
Opinion  Rating  of 

Flying  Qualities 

3600 

300 

100 

P.  TRAINING  AND  TEST  AGENDAS 

Both  pilot  subjects  vere  given  a  preliminary  orientation  session  in  which 
they  were  told  the  background  and  objectives  of  the  research  and  allowed  to 
familiarise  themselves  with  the  simulator  and  tasks.  This  was  followed  by  a 
training  session  during  which  preliminary  data  were  collected.  The  formal 
data  collection  then  occurred  during  two  further  sessions.  Tie  first  session 
involved  working  with  the  velocity  AFCS  longitudinal  task  dynamics,  and 
included  cross  adaptive  workload  measurements.  During  the  second  test  session, 
the  pitch  rate  feedback  AFCS  was  employed,  and  the  side  task  instabilities 
were  varied  as  indicated  in  Fig.  IV-4  to  give  both  low  and  high  workload  con¬ 
ditions  for  the  EPR  measurements.  The  run  logs  for  the  formal  data  sessions 
are  given  in  Tables  XV -6  and  IV- 7* 

Each  test  session  was  conducted  over  an  8  hour  period  with  the  pilots 
taking  turns  in  the  simulator  at  nominally  1  to  1  l/2  hour  intervals .  As 
mentioned  previously  the  test  sessions  were  conducted  on  a  shoot-look -shoot 
basis  and  do  not  reflect  formal  experimental  design  practice.  The  order  of 
presentation,  however,  was  randomized.  The  main  emphasis  was  on  obtaining 
data  that  were  valid  from  both  the  experimenters'  and  pilots'  points  of  view, 
and  that  would  demonstrate  the  usefulness  of  the  various  measurement  techniques 
employed  here  for  display  evaluation. 

0.  ORGANIZATION  OF  THE  RESULTS 

In  the  previous  subsection,  we  discussed  four  different  classes  of 
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TABLE  1 7-6 .  RON  LOG  FOR  THE  FIRST  FORMAL  EXPERIMENTAL  SL3SI0N 
WITH  THE  mOCITT  AFCS  COMROLIED  ELEMENT 
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Pilot 

Main  Task 

Display 

Lead  Time 
Constant, 

(sec) 

PB 

State 

-0- 

State  +  Rate 

■y  r- 

‘  • J 

Flight  Director 

1.5 

FP 

State  +  Rate 

1.5 

State 

-c- 

Lunch 

State  +  Rate 

3.0 

State 

-0- 

PB 

Flight  Director 

i  -5 

State  *  Rate 

1 .5 

Fit.  Dir.  (no  State) 

1.5 

Flight  Director 

5-0 

Flight  Director 

3.0 

State  +  Rate 

1.5 

FP 

State 

-0- 

Fit.  Dir.  (no  state) 

1.5 

Flight  Director 

1  *5 

1 _ 

State  +  Rate 

3.0 
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TABID  IV- 7.  HUH  L03  FOR  TEE  SECOND  FQRML  2XRSSXMEFT/tL 
SE18IQN  WITH  TEE  PITCH  AFC'S  CCSTROIIED  EISSS35T 


r  ' 

Pilot 

Main  Task 
Display 

Lead  Time 
Constant,  Tr, 
(sec)  L 

EPR 

Measurements 

Side  ] 

Task  s 

Workload 

i 

PB 

State 

State 

State  +  Rate 
State  +  Rate 

-0- 

-0- 

5.0 

1 .0 

No 

Low 

FP 

1 .0 

PB 

Fit.  Dir.,  FE 

1 .0 

Lunch 

PE 

Fit.  Dir.,  FD 

3.0 

FP 

Fit.  Dir.,  me 
Fit.  Dir.,  FD2 
State 

State  +  Rate 

3.0 

3.0 

-0- 

3.0 

PB 

State  +  Rate 
State 

Fit.  Dir.,  FD1 

3.0 

-0- 

3.0 

FP 

Fit.  Dir.,  FD1 

3.0 

Yes 

Fit.  Dir.,  FD1 

3.0 

PB 

State 

-0- 

State  i  Rate 

3.0 

State  +  Rate 

3.0 

High 

FP 

State 

-0- 

Fit.  Dir.,  FD1 

3.0 

Fit.  Dir.,  FD1 

1 .0 

PB 

Fit.  Dir.,  FD1 

1.0 

No 

*Flight  Director  equations  given  in  Figure  IV-6. 
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measurements  which  were  made  during  the  course  of  these  pilot  experiments 
for  a  theory  of  integrated  display  format.  These  four  classes  of  measurements 
are  repeated  below  with  a  list  of  the  specific  forms  in  which  the  results  of 
each  class  of  measurement  will  be  discussed. 

1 .  Performance  and  Describing  Functions 

a.  Tracking  errors,  coherence,  relative 
remnant,  control  and  motion  variables 

b.  Describing  Functions 

2.  Eye-Point-of -Regard  (EPR) 

3.  Cross  Adaptive  Excess  Control  Capacity 

4.  Pilot  Opinion  Ratings 

Because  of  the  extraordinary  volume  of  results  which  has  been  obtained  from 
these  experiments,  we  have  chosen  to  call  attention  to  specific  observations 
about  each  type  of  measurement  in  a  terse  illistrated  review  rather  than  to 
attempt  to  present  all  the  results  in  detail.  Following  each  review,  we 
shall  endeavor  to  relate  key  results  to  the  pre -experiment  analysis  which 
was  performed  and  to  the  theory  of  manual  control  displays. 

Since  we  have  also  six  display  configurations  and  two  controlled  elements 
to  discuss,  we  have  abbreviated  the  notation  for  each  in  the  following  ways. 

The  primary  display  configurations  are  denoted  by  alphabetical  letters  and  by 
a  number  which  represents  the  lead  equalization  time  constant,  TL  (sec),  used 
to  scale  the  error  rate  display  or  the  error  rate  signal  in  the  flight  director. 
These  primary  display  configuration  codes  are  repeated  below  with  their 
definitions. 

5  "State"  without  rate  (no  longitudinal  error  rate  symbol) 

6  +  R  "State -and -Rato"  (longitudinal  error  rate  symbol  added  to  S) 

with  T^  specified  in  aec. 

FD  "Flight  Director"  with  specified  in  sec  for  Yc  ■  K/a  and 

including  pitch  attitude  feedback  scaled  at  K^/K-  ■  -20  ft 
for  Yc  ■  K/s2 

FT)1  "Flight  Director"  with  TL  specified  in  sec  and  Kg/Kjr  ■  -100  ft 

for  Yc  -  K/s2 

FD2  "Flight  Director"  with  Tr  specified  in  sec  and  Kg/K^  *  “5°  ft 

for  Yc  ■  K/s2 

D  "Director"  display  without  longitudinal  error  symbol  and  with 

Tj^  specified  in  aec  for  Yc  •  K/s. 


The  primary  controlled  element  with  a  velocity  AFCS  is  denoted  by  Yc  ■  K/s. 

Similarly ,  with  a  pitch  AFCS,  the  primary  controlled  element  is  denoted  by 
Yc=K/s2. 

H.  TRACKING  ERRORS,  COHERENCE,  CONTROL  AND  MOTION  VARIABLES 

This  class  of  measurements  is  often  termed  "performance”,  because  it 
describes  the  pilots’  control  activity  and  vehicle  motions  as  well  as  the  task 
error.  Three  types  of  error  measurements  were  obtained  in  these  experiments 
l)  average  errors  and  2)  mean-squared  errors  (variances)  over  each  100  sec 
run  length,  and  3)  error-to-input  describing  functions  at  each  of  the  five 
input  frequencies.  Both  coherent  and  incoherent  error  spectra  were  computed 
at  the  five  input  frequencies  by  our  on-line  serial  segment  technique  (Ref.  29)* 
These  spectra  revealed  that  the  signal-to-reranant  power  ratio  at  each  of  the 
measurement  frequencies  was  on  the  order  of  10:1,  even  though  the  average 
coherence  might  have  been  only  about  O.5.  This  was  because  all  of  the  input 
power  was  concentrated  at  the  five  frequencies. 

The  ratio  of  the  incoherent  error  variance  to  the  total  error  variance  is 
called  the  relative  remnant  over  each  100  sec  run  length.  Since  the  computed 
remnant  error  spectra  have  offered  no  new  insight  for  display  evaluation  based 
on  the  frequency  distribution  of  uncorrelated  error  power,  we  shall  not  illus¬ 
trate  tne  remnant  error  spectra  here.  Instead,  we  shall  show  some  effects  of 
display  configuration  on  the  more  compact  average  metric:  relative  remnant. 

Figure  IV-7  shows  the  velocity  error  coherence,  p§e»  the  relative  remnant, 

1  —  p^,  and  the  variance  ratio,  aue/crui>  as  a  function  of  display  configura¬ 
tion  with  Yc  =  K/s.  The  variance  ratio  is  normalized  with  respect  to  the 
leader's  (input)  variance,  The  results  for  each  run  by  each  subject  are 

presented  at  the  left  when  averaged  over  the  entire  100  sec  run  duration. 
Selected  runs  are  presented  at  the  right  when  averaged  over  the  100  sec  run 
duration  in  four  serial  segments  of  25  sec  each.  Differences  between  the 
coherence  and  variance  averaged  in  these  two  ways  for  the  same  run  by  each 
subject  are  indicative  of  non-stationarity  in  pilot  tracking  behavior.  There 
are  evidences  of  slight  differences  in  this  regard  in  Fig.  IV-7,  primarily 
with  the  flight  director  display. 

Both  subjects'  velocity  error  coherence  was  less  in  using  the  flight 
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Pilots:  OPB  ,  0  FP  ;  Replications  Tagged  ;  Yc  =  K/s  ;  (710527) 


Error 
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TL(sec)  =  1.5  1.5 
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a 

0 


0.2  H 
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S  S+R  FD 
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Display  Configuration 


Averaged  over  the  entire 
100  sec  run  duration 


Selected  runs  averaged 
over  the  100  sec  run  In 
serial  segments  of  25  sec 


Figure  IV -7.  Velocity  Error  Performance 
with  Velocity  AFCS 
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director  with  Yc  =  K/s,  and  both  subjects  achieved  lower  velocity  error 
variance  with  the  flight  director  (Fig.  IV-7),  because  both  adopted  higher 
gain  equalization  with  the  flight  director. 

Subject  FP's  velocity  error  coherence  was  always  less  than  subject  PB's 
coherence  with  Yc  =  K/s  (Fig.  IV-7),  because  of  FP's  higher  gain  equalization 
technique.  (Recall  that  subject  FP  had  the  much  smaller  amount  of  helicopter 
time. ) 

Figure  IV-8  shows  the  corresponding  velocity  coherence  and  variance  ratio 
with  the  controlled  element  Yc  =  K/a2;  At  least  for  the  three  runs  analyzed 
in  serial  segments,  there  is  strong  evidence  for  non-stationarity  in  FP's 
coherence  with  the  S  and  S  +  R  formats.  PB's  coherence  tended  to  increase 
slightly  on  the  state-and-rate  format  and  on  the  better  director  format 
(Tl  =  3  sec)  with  Yc  =  K/s2.  His  coherence  dropped  markedly  on  the  off- 
design  director  format  (Tl  =  1  sec)  with  Yc  =  K/s2  and  on  the  off -design 
director  format  (T^  =  3  sec)  with  Yc  =  K/s. 

For  corresponding  display  configurations,  the  normalized  velocity  error 
variance  is  always  greater  with  Yc  *»  K/s2  (Fig.  IV-8)  than  with  Yc  =  K/s 
(Fig.  IV-7).  Furthermore,  both  subjects  amplified  the  leader's  velocity 
variance  with  the  S  format  and  Yc  =  K/s2  (Fig.  IV-2). 

There  is  no  consistent  evidence  of  the  influence  of  low  and  high  side 
task  workload  on  subject  PB's  velocity  error  coherence  and  variance  with 
Yc  =  K/s2  (Fig.  IV-8). 

Likewise,  there  is  no  consistent  evidence  of  the  influence  of  low  and  high 
side  task  workload  on  subject  FP's  velocity  error  variance  with  Yc  =  K/s2 
(Fig.  IV-8) .  With  the  exception,  however,  of  the  preferred  flight  director 
(Tl  *»  3  sec)  configuration,  FP's  velocity  error  coherence  was  about  0.2  point 
lower  in  replications  of  the  primary  task  with  the  higher  secondary  task 
workload . 

Subject  FP's  tracking  error  variance  and  coherence  (or  relative  remnant) 
are  more  sensitive  to  display  configuration  with  controlled  element  Yc  »  K/s2 
(Fig.  IV-8)  than  with  Yc  *  K/s  (Fig.  IV-7). 

Relative  remnant,  although  sensitive  to  display  content  with  Yc  «  K/s2 
(Fig.  IV-8)  where  lead  equalization  is  required,  is  more  sensitive  to  change 
in  the  pilots'  gain  equalization  technique  than  to  display  format  (Figs.  IV-7,  8). 
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Pilots:  OPB  ,0FP  ;  Replications  Togged  ;  Yc  =  K/s2  ;  (710528) 
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The  lowest  tracking  error  variance  and  the  lowest  relative  rerariant  with 
Yc  -  K/s2  were  achieved  with  a  pro;jerly  equalized  flight  director  having 
T^  =  3  sec  (Fig.  IV-3) .  This  value  of  agreed  closely  with  the  predicted 
best  value,  T^  =  3*3  sec.  !  , 

The  lowest  tracking  error  variance  with  Yc  »  K/s  was  achieved  with  a 
flight  director  display  by  both  subjects  !  ’Fig.  I1N7);  however,  the  lowest 
relative  remnant  with  Yc  ■  K/s  was  achieved  without  a  flight  director  by 
subject  PB,  because  his  describing  function  shows  that  he  chose  to  adopt  a 
lower  gain  equalization  technique  with  3  and  S  +  R.  (Fig.  IV-12). 

i 

\ 

The  mean  errors  and  root-mean-square  errors  from  trimmed  Values  of  ether 
motion  variables  and  control  displacements, shown  for  selected  runs  in  Figs. 

IV-9  and  10, are  more  sensitive  to  piloting  technique  than  to  display  config¬ 
uration.  The  FD,  however,  does  help  to  achieve  the  lowest  RIB  longitudinal 
displacement  error. 

The  secondary  task  errors  shown  for  selected  runs  in  Fig.  IV-ll  arte  not 

l 

sensitive  to  primary  display  configuration  with  either  controlled  element. 

Since  most  of  the  trends  in  the  measures  of  performance  presented  here  can 

»  } 

be  "explained"  by  the  trends  in  the  subjects'  adopted  describing  function  gains, 
we  shall  defer  the  discussion  of  performance  until  the  describing  functions 

i 

themselves  have  been  presented.  1 

I.  INSCRIBING  FUNCTIONS 

The  amplitude  and  phase  angle  of  both  open-and  closed-loop  describing. 1 
functions  were  computed  from  the  measurements  by  the  Fourier  analyzer  (DFA) 
at  each  of  the  five  input  frequejeies.  The  extended  crossover  model  (Ref.  10) 
provided  a  good  representation  of  the  open-loop  describing  functions  (YpYg) 
in  the  neighborhood  of  the  unit-gain  crossover  frequency  o\,.  This  parameter 
determines  the  effective  closed-loop  tracking  bandwidth.  Therefore,  we . have 
used  an  automatic  computer-interpolation  program  to  select  appropriate  values 
of  the  effective  time  delay,  Te  ,  and  the  low  frequency  lead-lag  phase  copf- 
ficient,  ac,  for  fitting  the  extended  crossover  model  to  the  two  measurements 

i  , 

nearest  We  believe  that  the  extehded  crossover  model  parameters  (e>e>  tCc> 
aGj  cp^j,  and  %,)  fitted  in  this  simple  way  adequately  represent  the  dominant 
describing  function  properties  for  the  purposes  of  display  evaluation. 
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Pilots:  O  ,PB. ,  0’  FP  ;  Repl  loot  Ions  Tagged  ;  Yc  =  K/s  ;  (710527) 
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Pilots:  O  PB, 0  FP  ;  Replications  Togged  ;  Yc  *  K/s2  ;  (710528) 
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Figure  IV-10.  Selected  Runs  at  High  Workload  Shoving  Mean  Errors 
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1  .  Observations  on  the  Open-Loop  Crossover  Model  Parameters  for  YpYc  with 
Yc  =  K/s. 


The  computed  parameters  are  shown  as  a  function  of  the  primary  display 

configuration  in  Fig.  IV-12.  The  measure':  range  of  adopted  crossover  frequen- 

cies  with  the  S  format  and  Y,  =  —  was  0. 32  <  u)c  <  0.57  - — •  The  predicted 
rad  ^  s  *”  sec 

value  was  0.4  - . 

sec 

The  measured  range  of  adopted  crossover  frequencies  with  the  preferred 
director  (Tr  «  1  .5  sec)  for  Yc  =>  —  was  0.7  <  ts  <  1.0  - — .  This  higher  gain 
explains  the  lower  velocity  error  coherence  and  normalized  variance  with 
FD(TL  =  1.5  sec)  in  Fig.  IV-7. 

Subject  PB's  piloting  technique  was  more  consistent  then  FP's  technique. 

Subject  FP  adopted  very  high  crossover  frequencies  with  the  error  rate  display 

configurations  (S  +  R,  FD)  by  taking  advantage  of  the  higher  frequency 

( circa  2  second  order  lead  equalization  inherently  provided  by  this  con- 

—  —  sec 

trolled  element.  FP's  technique  is  reflected  in  lower  effective  time  delays, 
higher  phase  margins,  and  higher  unstable  frequencies  than  those  recorded  for 
PB. 

The  trends  in  adopted  crossover  frequency  among  display  configurations 
and  between  subjects  "explain"  the  comparable  trends  in  normalized  error 
variance  and  coherence  shown  previously  in  Figs.  IV-7  and  8. 

2.  Observations  on  the  Open-Loop  Crossover  Model  Parameters  for  YpYc  vith 
Y0  -  K/*2 . 


The  computed  parameters  are  shown  as  a  function  of  the  primary  display 
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Tbs  measured  phase  margins  were  between  20  and  j6  deg  for  the  S  and 
FDCT^  *=  3  sec)  formats.  Predicted  crossover  frequencies  were  baaed  on  phase 
margins  of  36  deg  for  the  state  format  and  35  deg  for  the  director.  The 
measured  phase  margins  were  greatest  with  the  state-and-rate  format 
( 3’ 0  <  %  <  66°) . 

The  effective  time  delays  for  subject  FP  were  greater  than  for  subject  PB 
except  with  display  FD(Ti,  =  3  sec).  The  effective  time  delays  were  roughly 
comparable  between  the  S  and  the  S  +  R  formats  and  appreciably  lower  with  the 
preferred  FD(Tl  =  3  sec)  format.  The  result  with  the  preferred  director  vould 
be  expected,  since  Fig.  IV-14  shows  that  the  pilots  did  not  have  to  adopt  low 
frequency  lead  equalization  with  its  consequent  incremental  time  delay  tc  get 
the  results  displayed  in  Fig.  IV-9.  The  results  for  the  state -and -rate  format 
suggest  that  explicit  presentation  of  the  rate  symbol  integrated  with  the 
position  error  symbol  did  not  reduce  the  effective  time  delay  accompanying  the 
adoption  of  lead  equalization  by  the  pilots,  although  it  did  reduce  the  scan¬ 
ning  workload  required  for  monitoring  speed  variations,  as  the  EPR  measurements 
will  show.  An  hypothesis  for  the  state -and -rate  result  is  advanced  in  Ref.  4. 

The  effective  low  frequency  phase  approximatior  coefficients,  for  pilot 
PP  are  leas  variable  than  for  pilot  FP.  Those  for  PB  are  roughly  comparable 
between  the  state  and  the  state-and-rate  formats  and  appreciably  nigher  with 
the  best  director.  This  result  reflects  the  difference  between  the  lead-lag 
equalization  supplied  by  the  pilot  with  the  state  and  the  state-and-rate  formats 
and  the  similar  type  of  equalization  supplied  by  the  effective  controlled 
element  with  che  preferred  flight  director  display.  The  preferred  range  of 
pitch  attitude  feedback  gains  to  the  flight  director  shown  in  Figs*  IV- 1 4  and  15 
was  chosen  by  the  pilots  based  on  the  relatively  low  rate  of  director  null 
axis-crossing  required  to  maintain  tight  pitch  attitude  control  while  perform¬ 
ing  the  primary  task.  The  preferred  range  of  K$/KXe  includes  the  value  -62.5  ft, 
which  was  predicted. 

The  measured  phase  crossover  (unstable)  frequencies  showed  great  variability 
among  all  display  configurations,  subjects  and  replications.  Their  rar’ge  was 
lowest  with  the  state  format  (Figs.  1V-6  and  7). 

J.  EXB -K'HT-OF -REOARD  MASUFEIOTBS 

K 

All  of  the  EPR  data  were  obtained  with  Ye  =  for  the  longitudinal 


station-keeping  task.  However,  two  levels  of  workload  were  established  for 
the  altitude -keeping  task  in  order  to  determine  the  effects  of  a  more  and  a 
less  demanding  secondary  task  on  the  EPR  measurements  and  pilot  ratings. 

Some  effects  of  secondary  task  workload,  subjects,  and  display  configuration 
on  the  EPR  are  illustrated  in  Figs.  IV-16  and  17* 

Figui'e  IV-16  presents  examples  of  the  time  histories  of  the  EPR  on  each 
display  format  for  both  subjects  at  the  two  levels  of  secondary  workload. 

Figure  IV-17  compares  some  of  the  average  fixation  sampling  intervals  and 
dwell  times  which  have  been  estimated  from  the  EPR  data  at  the  two  levels  of 
workload.  A  complete  summary  of  average  scanning  properties  with  high  work¬ 
load  is  presented  in  Fig.  IV-18  and  with  lower  workload,  in  Figs.  IV-19  and  20. 

Before  we  discuss  and  interpret  some  of  the  EPR  data  in  the  light  of  pre- 
experimental  predictions,  we  shall  offer  a  concise  summary  of  observations 
from  the  EPR  data  presented  in  Figs.  IV-17  through  20  in  terms  of  the  most 
notable  effects  of  workload,  subject  pilots,  and  display  configurations. 

1  *  Concise  Summary  of  EPR  Observations  from  Figures  IV-16  through.  20 

a.  Workload  - 

•  More  blinking  (spikes  in  traces)  with  the  lower  workload 
condition  (Fig.  IV-l6) 

•  Higher,  more  regular  scan  rate  for  the  higher  workload 
condition  (Figs.  IV-16  and  18) 

•  Monitoring  workload  margins  were  measurably  reduced  by 
the  state -and -rate  and  director  for.aats  for  the  lower 
workload  condition  (Fig.  IV-19) 

b.  Pilots  - 

•  PB  has  a  lower  scan  rate,  a  higher  side  task  dwell,  and 

a  more  regular  scan  pattern  than  FP  (Figs.  IV-17>  18  and  ’9) 

•  FP  did  more  monitoring  than  PB  (Fig.  IV-19) 

c.  Displays  - 

•  Definite  scanning  within  the  CRT  for  flight  director  display 
(Fig.  IV-16)  (looking  between  FD  and  symbols)  with  about 
equally  partitioned  dwells  of  about  0.5  sec  for  the  lover 
workload  condition.  (Fig.  IV-20) 
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9  Definite  scanning  between  he  and  fi  displays  (Fig.  IV-16) 

•  Scanning  Behavior  similar  between  pilots  for  low  workload 
condition  (Figs.  IV-17,  19  and  20) 

•  CRT  dwell  time  trends  quite  different  between  pilots 
under  high  workload  (Fig.  IV-17) 

•  Fairly  constant  side  task  dwell  times  over  all  display 
and  workload  conditions  (as  noted  ir.  previous  research, 
e.g.  Ref.  9)  (Fig.  IV-17) 

2.  Discussion  of  EFR  Results 

The  airspeed  indicator  was  not  monitored  by  either  subject  with  the 
more  demanding  altitude-keeping  task.  However,  even  with  the  less  demanding 
side  task  (Fig.  F/-19),  the  lock  fractions  on  the  CRT  and  the  side  task  are 
nearly  0.5  each,  so  that  very  little  monitoring  of  the  circular  airspeed 
Indicator  and  altimeter  occurred  with  the  state  format.  (More  monitoring 
fractions  were  predicted  than  occurred.)  The  monitoring  fractions  were 
reduced  further  with  the  state -and -rate  and  director  formats.  Monitoring 
dwell  intervals  and  side  task  dwell  intervals  were  seldom  less  than  0.5  sec. 

The  altitude  control  side  task  dwell  fraction  agreed  well  with  the 
predicted  value  0.57  under  conditions  of  high  workload  in  Fig.  IV-18.  Dwell 
fractions  on  the  CRT  under  conditions  of  high  side  task  workload  were  slightly 
greater  than  the  predicted  value  (0.57)  by  the  amount  (0.06)  predicted  for 
monitoring  airspeed  and  altitude. 

Under  conditions  of  high  workload  in  Fig.  IV-18,  subject  FB’s  scanning 
frequency  on  the  CRT  for  the  state  format  (0.J9  Kz)  agreed  well  with  the 
predicted  value  (o.U  Hz).  FP's  scanning  frequency,  however,  on  the  same 
format  (0.84  Hz)  was  over  twice  the  predicted  value. 

•  In  an  effort  to  coalesce  the  effects  of  the  several  scanning  variables, 
we  have  computed  a  unifying  parameter  combination  which  appears  in  severs! 
derivations  for  finlte-dvell  sampling  and  is  termed  the  "Scanning  Frequency 
Parameter"  8:  (Ref.  9  ond  18) 

8  « 

Mi  -  n) 

vhere:  u^/u>c  ■  ratio  of  scannlng-to-croaaover  frequencies 
T>  «  -  dwell  fraction 


Oii 


**■**■)  1  P(  T  O 


If  we  denote  the  average  nonfixated  period  by  T.  =  Ta  -  T,.  and  the  crossover 
period  as  Pc  »  2rt/cDc,  algebraic  manipulation  of  the  above  expression  gives 
the  simpler  expression:  S  ®  Pc /T^  .  This  suggests  a  simple  physical  meaning 
for  S,  as  the  ratio  of  the  crossover  period  relative  to  the  time-avay  from 
the  display.  This  ratio  should  be  large  to  minimize  scanning  remnant  effects. 

The  results  of  this  computation  of  S  are  shown  in  Fig.  IV-21 .  Subject  PE's 
normalized  scanning  frequency  parameter,  S,  was  closely  bounded  (lU  <  3  <  1 8) 
for  all  display  configurations  at  high  workload,  whereas  FP's  measured  values 
of  S  ranged  between  19  and  35  >  when  the  dwell  fraction  on  the  CRT,  was 

used  in  the  computation  of  S. 

Scanning  among  symbols  on  the  CRT  (called  ” internal  CRT  scanning,”  for 
short,  in  Fig.  IV-20),  however,  is  evident  with  both  low  and  high  side  task 
workload.  [Winblade  (Ref.  28)  also  noted  scanning  among  CRT  symbols  on  an 
integrated  vertical  situation  display  in  previous  research.]  When  scanning 
rmong  CRT  symbols  with  lower  workload  is  accounted  for  by  using  manual  control 
theory  tog<  ther  with  the  simplest  of  describing  function  measurements  (exempli¬ 
fied  by  the  crossover  model,  the  partitioned  scanning  frequency  parameter,  S, 
for  the  preferred  flight  director  (T^  «*  3  Bee)  with  Yc  ■  K/s^  becomes  very  nearly 
the  same  value  for  both  subjects,  whereas  3  exhibits  a  two-fold  difference  if 
otherwise  based  on  CRT  scanning  as  a  whole  (Fig.  IV-21 ) .  This  finding  is  con¬ 
sistent  with  the  close  agreement  between  coherence  (Fig.  IV-8)  and  crossover 
frequency  (Fig.  IV-13)  for  both  subjects  with  the  sane  flight  director  and 
Yc  -  K/a2. 

Velocity  error  coherence  of  subject  FP  (<  0.1+3)  in  Fig.  IV-8  vac  much  lower 
than  predicted  (0.75)  with  Yc  «  K/s2  for  the  state  format.  Since  the  normalised 
eye  scanning  measurements  (S  ■  35)  for  subject  FP  with  the  state  format  agreed 
quite  well  with  predictions  (8  -  39 )»  another  significant  source  of  remnant  such 
aa  non-atationarity  may  have  been  present.  The  difference  between  whole  run 
length  average  coherence  and  serial  segment  average  coherence  vould  tend  to  con¬ 
form  the  presence  of  non-atationarity.  Pilot  FP’s  coherence  increased  about 
tvo-fold  on  tho  state -and -rate  format  and  increased  to  a  level  comparable  vith 
PR's  coherence  (0.0  <  pu@  <  0.9)  on  tho  better  director  format  (FD:  •  3  sec). 

Velocity  error  coherence  of  subject  PB  was  about  equal  to  that  predicted 
(0,75)  for  the  state  format  with  Y„  •  K/s2.  However,  EPK  measurements  (summer- 
ized  separately)  for  subject  PB  vith  the  state  format  shoved  a  cona latently 
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lover  foveal  seaming  frequency  parameter  (S^  <  18)  than  the  effective  value 
predicted  (Se  *=  39)  to  achieve  the  coherence  of  0,75*  This  roughly  two»fold 
difference  in  S  can  he  attributed  to  the  two-fold  difference  between  the  meas¬ 
ured  (foveai)  and  predicted  (effective)  interrupt  fractions  on  the  primary 
display  (CKT).  (Measured  1  -  iyr^  =  0.32j  predicted  1  -  qe  =  0. 1 6  to  achieve 
coherence  of  0.75  which  actually  approximately  agreed  with  the  measured 
coherence.)  Thi3  difference  is  quite  consistent  with  that  attributable  to 
the  effects  of  parafoveal  viewing.  In  fact,  an  estimate  of  PB's  average 
parafoveal-to-foveal  gain  ratio,  n,  can  he  inferred  from  the  relationship 
(Kef .  2)  between  0  and  the  two  interrupt  fractions 

t}e  "  *lf  0  “  ne) 

n  «=  - — ~  a  i  ~  - -  0.5 

1  “  %  (1  -  r\t) 

This  example  shown  how  coherence  (relative  remnant),  EFR,  and  crossover 
frequency  measurements  can  be  gainfully  combined  with  manual  control  display 
theory  to  infer  the  effectiveness  of  a  pilot's  parafoveal  visual  ability 
which  cannot  he  directly  observed! 

EFR  measurements  alone  are  not  sufficient  to  serve  as  a  measure  of  the 
quality  of  an  integrated  display.  However,  EFR  measurements  ere  a  necessary 
adjunct  in  concert  with  coherence,  describing  function,  and  excess  control 
capacity  measurements  to  help  in  discovering  the  rationale  for  pilots'  adopted 
tracking  control  behavior  when  confronted  with  an  integrated  display.  Within 
the  constraints  of  a  precision  flight  control  task  involving  high  attentional 
workload,  the  integration'  of  the  displayed  variables  required  for  control 
and  monitoring  c-au  help  the  pilot  in  two  ways.  First,  the  integration  may 
relieve  a  saturated  ^or  potentially  over  saturated)  scanning  condition. 

Second,  the  integration  may  help  to  increase  the  controlling  scanning  workload 
fraction  by  reducing  the  monitoring  scanning  workload  fraction,  which  is,  of 
necessity,  small  anyway.  In  either  or  both  of  these  ways  the  integration  may 
effect  a  reduction  in  the  whole -task  remnant  and  effective  time  delay  with  a 
consequent  measurable  increase  in  excess  control  capacity  for  coping  with 
unexpected  workload. 


K.  THE  CROSS  ADAPTIVE  M5ASURE  OF  EXCESS  CONTROL  CAPACITT  AHD  SUBJECTIVE 
RATIIfW  OE  DISPLAY  QUALITY 

In  our  first  application  of  the  cross-coupled  secondary  subcritical  task 

for  display  evaluation,  secondary  scores  reflecting  a  measure  of  excess  control 

capacity  have  been  obtained  with  Yc  -  — •  This  is  believed  to  be  a  faix'ly 

s 

sensitive  test  of  the  cross-adaptive  task  for  the  purpose  of  display  evaluation 

for  two  reasons.  First,  the  controlled  element  did  not  require  low  frequency 

lead  equalization  wi+h  its  concomitant  incremental  effective  time  deley  which 

is  known  to  reduce  the  cross  adaptive  measure  of  excess  control  capacity.  (Vide 

Appendix  A.)  Second,  the  subjective  pilot  ratings  of  attentional  demand  in 

Fi?.  IV-22  were  not  sensitive  to  display  configuration  with  Yc  ■  — ,  whereas 

8  K 

the  same  ratings  were  more  sensitive  to  display  configuration  with  Yc  «  , 

which  does  require  low  frequency  lead  equalization. 

The  secondary  scores  obtained  on  the  several  primary  display  configurations 
are  shown  in  Appendix  A,  Fig.  "  add  described  in  the  accompanying  text  of 
Appendix  A.  The  results  for  both  pilots  show  that  the  cross  adaptive  measure 
of  excess  control  capacity  appears  to  be  a  more  unique  measure  of  display 
quality  them  does  relative  remnant  on  scanning  workload  fraction  and  a  more 
sensitive  measure  than  subjective  opinion  with  YP  - 

'  B 

Among  the  other  subjective  display  quality  ratings  in  Fig.  IV-16,  the 

off -design  flight  directors  (Tl  -  J  sec  with  Ye  -  j  and  T^  ■  1  sec  with  Yc  • 

were  down  rated  for  controllability  and  precision  by  both  subjects,  and  the 

director  format  (D)  without  task  error  was  down  rated  for  status  utility  as 

expected.  Pilot  PB  also  recognized  correctly  that  he  had  no  basis  for  rating 

"precision"  of  the  task  with  format  D.  As  noted  previously,  attentional  demand 

K 

ratings  were  sensitive  to  primary  display  configuration  with  Yc  •  -jr  and  to 
the  workload  on  the  altitude-keeping  task  in  predictable  senses.  The  following 
table  compares  predicted  and  measured  ratings  for  "controllability-and-preclslon" 
and  "attentional  demand".  Other  ratings  by  the  pilots  did  not  show  distinct  or 
unique  trends  with  display  configuration. 
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SECTION  V 


CONCLUSIONS  AND  RECOMMENDATIONS 

A.  CONCLUSIONS  FROM  TEE  RESEARCH  AND  IMPLICATIONS  FOR  A  THEORI  OF 

INTEGRATED  DISPLAT  FORMAT 

The  first  (single-axis)  experiment  gave  results  which  led  to  the 
following  conclusions  with  respect  to  the  various  formats  which  were 
t23ted.  The  cjuocitized  format,  at  least  with  the  comparatively  coarse  quan¬ 
tization  which  was  employed  in  the  experiments,  caused  an  incremental 
effective  time  delay  of  approximately  0.1  sec  under  "both  foveal  and  para¬ 
foveal  viewing  conditions.  For  this  reason,  this  type  of  display  is  not 
to  he  recommended  for  precision  tracking  tasks.  Use  of  the  vertical  bar  format 
( thermometer  type)  caused  notably  degraded  performance,  and  the  format 
should  preferably  not  be  employed  in  closed-loop  tracking  tasks.  There 
were  no  distinctive  differences  in  measures  of  pilot  behavior,  coherence 
or  error  scores  between  foveal  and  parafoveal  tracking  with  the  line  and 
dial  formats  as  long  as  the  parafoveal  viewing  angle  wa3  10  deg.  At  a 
20  leg  parafoveal  viewing  angle,  however,  these  measures  deteriorated. 

For  example,  a  display  designer  might  be  impelled  to  increase  the  field 
of  view  of  an  integrated  display  format  to  improve  the  pilot's  las is  for 
monitoring  the  situation.  Alternatively,  the  designer  might  want  to 
increase  the  displayed  field  of  view  to  reduce  foveal  clutter  among  symbols 
In  a  dense  format,  if  the  content  must  be  preserved  and  the  field  of  view 
scaling  does  not  otherwise  have  to  be  In  the  ratio  1 :1  with  the  real  world. 
However,  the  results  of  the  single -axis  experiment  imply  that  increasing 
the  field  of  view  of  an  integrated  display  foiraat  greater  than  about  10  deg 
will  produce  diminishing  returns  through  the  relatively  greater  deterioration 
of  parafoveal  tracking  ability. 

In  connection  with  integrated  display*  for  multi- axis  tracking  tasks 
(the  second  experiment)  the  theory  of  manual  control  displays  has  been 
successfully  employed  in  designing  display  evaluation  experiments  so  as  to 
isolate  the  effects  of  the  controlled  element,  the  effects  of  individual 
pilot  behavior  and  the  difficulty  of  the  task  from  the  effects  of  the  display 
itself.  Use  of  the  secondary  cioss -adapt? ve  sub-critical  tracking  task,  by 
separately  identifying  a  measure  of  tracking  precision  from  a  measure  of 
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excess  control  capacity,  can  enable  one  to  understand  some  of  the  heretofore 
confounding  effects  caused  by  employing  difficult  controlled  elements  with¬ 
out  proper  equalization  in  display  evaluation  experiments.  The  secondary 
cross -adaptive  measure  of  excess  control  capacity  on  the  pilot's  primary 
task  discriminates  among  examples  of  display  format  and  content  in  a  sense 
which  is  predictable,  because  the  cross-adaptive  task  can  guarantee  that 
the  pilot  will  be  fully  occupied  with  relevant  tracking  control  tasks 
during  the  workload  measurement  interval. 

Although  eye  scanning  patterns  are  relevant  to  workload  (e.g.  Vide 
Appendix  A),  the  relationship  is  not  a  simple  one.  Since  there  is  a 
minimum  dwell  time  of  about  0.4  sec  for  monitoring  each  instrument  or 
symbol  under  IFR  conditions,  it  is  possible  to  contrive  saturated  con¬ 
ditions  where  the  control  task  demands  fixations  by  the  pilot  on  too 
many  instruments  too  often  in  order  to  maintain  control.  However,  even 
without  driving  the  pilot  to  his  controllability  limit,  the  interpreta¬ 
tion  of  eye-point-of -regard  data  alone  will  sometimes  be  ambiguous  if  one 
is  looking  for  a  measure  of  excess  control  capacity.  The  ambiguity  will 
arise  in  the  interpretation  of  the  partition  of  scanning  workload  between 
displays  foi  controlling  the  task  and  for  monitoring  the  situation.  This 
partition  of  scanning  workload  is  not  uniquely  related  to  excess  control 
capacity  because  of  the  constraint  imposed  by  "Parkinson's  Law"  for  the 
eyeball  (vide  Appendix  A) .  The  partition  of  eye-point-of -regard  statis¬ 
tics  alone  may  not  reflect  the  partition  afforded  by  excess  control 
capacity  between  the  pilot's  subjective  confidence  level  in  the  situation 
and  the  pilot's  subjective  impression  of  the  difficulty  of  maintaining 
the  required  performance  on  the  task. 

Measure 8  of  the  pilot's  remnant,  although  sensitive  to  display  content 
where  lead  equal Ization  is  required,  are  more  sensitize  to  changes  in  the 
pilots'  gain  equalization  technique  than  to  changes  in  display  format.  The 
cross -adaptive  measure  of  excess  control  capacity  appears  to  be  a  more 
unique  and,  therefore,  more  useful  measure  of  display  quality  than  does 
either  tho  pilots'  remnant  or  the  eye-point-of -regard  by  itself. 

Th^  theory  of  manual  control  displays  already  embraces  the  ingredients 
for  a  valid  theory  of  integrated  display  format  founded  on  the  comprehensive 
behavioral  measurement  techniques  (coherence,  describing  function, 
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eye-point-of -regard,  and  excess  control  capacity)  applied  in  these  pilot 
experiments.  In  particular,  the  theory  offers  a  new  technique  for  dis¬ 
covering  the  suspected  correlation  among  display  format,  a  pilot's  parafoveal 
visual  ability,  and  attentional  workload  in  whole  cockpit  precision  flying 
tasks.  There  were  four  questions  about  an  ’’integrated"  display  which  were 
posed  to  us  by  the  JANAIR  Committee  in  1 966  when  research  on  the  theory  of 
manual  control  displays  was  first  initiated.  We  believe  now  that  we  have 
answers  to  these  questions.  The  questions  themselves  and  our  proposed 
answers  are  as  follows : 

What  is  an  integrated  display? 

It  is  a  combined  presentation  to  the  pilot  of  the  proper 
signals  for  controlling  as  well  aa  monitoring  the  perfor¬ 
mance  of  a  task.  Reference  3,  which  is  included  herein 
as  Appendix  A,  discusses  the  basis  for  this  answer  in 
terms  of  the  flight  director  (vide  pp.  A-1 ,  -2  herein) . 

In  the  multiaxis  tracking  experiment  reported  in  Section  IV, 
the  highest  measure  of  excess  control  capacity  was  obtained 
on  the  properly  equalized  integrated  flight  director  format, 
a  result  which  also  supports  the  proposed  answer  to  the 
first  question. 

How  may  the  proper  signals  for  manual  control  of  a  task  be 

predicted  and  verified? 

This  should  be  done  by  a  combination  of  systems  analysis 
theory  of  displays,  simulation  and  flight  test.  References 
1,2,3  and  3^  address  the  answer  to  the  question  of  predic¬ 
tion.  Reference  3»  which  is  included  herein  as  Appendix  A, 
also  addresses  the  question  of  verification  with  an  example. 

How  is  the  display  properly  integrated? 

This  is  done  1 )  by  providing  the  pilot  with  sufficient  excess 
control  capacity  in  a  raultiloop  display,  i.e.,  an  equalized 
display  or  a  flight  director,  2)  by  minimizing  the  scanning 
workload  for  monitoring  the  task  and  3)  by  choosing  a  content 
allowing  the  pilot  to  satisfy  all  task  performance  requirements. 

This  answer  is  also  supported  by  results  in  Appendix  A  and  by 
the  results  of  excess  control  capacity  and  eye-point-cf -regard 
measurements  in  the  raultiaxis  tracking  experiment  reported  in 
Section  IV. 

How  can  tho  display  be  evaluated? 

This  is  best  done  by  means  of  the  secondary  cross -adaptive 
subcritical  tracking  task.  This  task  measures  excess  control 
capacity,  including  the  effects  of  scanning  workload  and  whole- 
task  effective  time  delay,  while  the  pilot  maintains  the 
required  task  performance.  The  basis  for  this  contention  is 
described  in  Appendix  A. 
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Four  simple  pilot  rating  scales  for  use  in  research  on  and  evaluation 
of  manual  control  displays  were  derived  and  used  in  the  pilot  experiments 
reported  on  here.  The  scales  are  of  interval-scale  quality  and  will  per¬ 
mit  averaging  and  other  standard  parametric  statistical  analyses.  The 
use  of  four  trait  categories:  *)  task  controiiebility-and-precision, 

2)  status  utility,  clutter,  and  k)  attentional  demand  should  help  to 
separate  subjective  identification  of  these  often  confounded  effects. 

An  "integrated"  display  does  not  necessarily  eliminate  eye  scanning 
between  symbols  and  improve  tracking  coherence,  but  it  may  very  well 
increase  the  pilot's  excess  control  capacity  for  coping  with  the  unexpected. 
This  hypothesis  deserves  further  investigation,  test,  and  quantification 
as  a  basis  for  measuring  the  quality  of  an  "integrated"  display,  as  well 
as  a  whole  display  panel  arrangement,  in  a  sense  having  practical  value  to 
problems  of  military  and  naval  instrument  flying. 

B.  HECOramATIOITS  FOR  FORMAL  INTEGRATED  DISPLAY  EXPERIMENTS 

Since  it  has  now  become  clear  that  the  systems  analysis  theory  of 
manual  control  displays  already  embraces  the  ingredients  for  a  valid 
theory  of  integrated  display  format,  we  recommend  that  the  experimental 
data  base  for  integrated  display  design  calculations  be  increased  and 
related  to  a  practical  common  basis  for  evaluation,  viz.,  excess  control 
capacity.  To  this  end  we  recommend  further  development  and  practical 
application  of  the  cross -adaptive  measure  of  excess  control  capacity 
described  in  Section  IV  and  Appendix  A  for  the  purpose  of  formal  display 
evaluation  by  employing  a  weighted  sum  of  more  than  one  "primary'’  task 
error  variance.  We  also  recommend  that  the  subjective  display  quality 
rating  scales,  used  in  the  pilot  experiments  reported  herein,  be  employed 
in  future  display-related  simulations  to  provide  the  data  base  needed  to 
refine  the  scales  and  to  provide  a  basis  for  separating  tne  identification 
of  the  "status  utility"  and  "clutter  Index"  of  a  display  as  they  relate 
to  excess  control  capacity. 

We  continue  to  recommend  wich  increasing  confidence  that  anyone  con¬ 
templating  control-display  evaluation  or  related  research  should  apply 
the  systems  analysis  theory  of  manual  control  displays  first  to  est.ab]  luh 
the  content,  arrangement,  scaling  and  resolution  (as  well  as  automatic 
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stability  augmentation^  for  reducing  scanning  and  lead  equalization  work¬ 
load  in  the  visual  modality  before  attempting  to  evaluate  the  effects  of 
the  format,  i.e.,  the  relative  number, size,  type,  color,  contrast,  and 
separation  of  symbolic  elements  in  the  displayed  field  of  view. 

A  muitilocp  (equalized  or  flight  director)  frnnat  is  recommended  to 
provide  superior  excess  control  capacity  over  the  " state -and-rate"  format 
for  closed-loop  tracking.  However,  the  scaling  and  symbolism  of  the 
"state-and-rate"  format  should  be  investigated  for  the  acquisition 
of  a  guidance-and-control  tracking  reference,  because  the  excess  control 
capacity  of  the  state -and -rate  format  for  monitoring  the  acquisition  may 
be  relatively  greater  than  in  pure  tracking. 

The  subtended  angular  field  of  view  of  the  display  for  controlling  and 
monitoring  the  primary  task(s)  should  not  exceed  about  ten  degrees  in 
order  to  take  advantage  of  pilots’  parafoveal  visual  ability  in  tracking. 
Within  this  field  of  view  continue  to  use  cathode  ray  tube  line  symbols 
for  the  primary  task(s)j  limit  the  use  of  the  bar  format  to  monitoring;  avoid 
alpha-numeric-,  discrete-,  or  raster-quantization  on  the  order  of  rms  track¬ 
ing  signals;  and  avoid  moving  scale  formats  without  a  "command"  bug  for 
tracking.  Outside  this  primary  ten-degree  field  of  view  fixed  vertical 
scale  displays  for  monitoring  the  situation  tend  to  reduce  scanning  work¬ 
load  by  virtue  of  their  compact  width,  but  circular  dials  provide  better 
resolution  tnd  scale  length  within  the  sane  vertical  (diametric)  dimension. 

After  taking  into  account  all  of  the  foregoing  conclusions  and 
recommendations,  we  further  recommend  the  following  nlan  for  applying 
formal  integrated  display  experiments  to  a  problem  of  immediate  operational 
relevance . 

•  Adopt  recommendations  for  formel  experiments  based  on  the 

reported  "pilot"  experiments  re: 

(1)  content  fo>*  reducing  scanning  and  lead  equalization 
workload  the  visual  modality 

(2)  effects  of  Bcaling,  resolution,  field  of  view  and 
quantizati.ii. 

(3)  tf^-ls  of  symbol  and  scale  format 
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•  Use  a  cockpit  scenario  such  as  helicopter  IFR  approach  with: 

( 1 )  three-control  multiloop  task 

(2)  three-color  integrated  display  with  selectable 
line  symbols  for  IFR 

(3)  describing  function  analyser  for  forcing  functions, 
gain,  phase  and  coherence  measurements 

(4)  cros 8 -adaptive  sub-critical  task  for  measuring  the 
level  of  attentional  workload 

(5)  eye -point-of -regard  system  for  measuring  foveal 
fixation  statistics 

•  Investigate  symbol  color,  contrast  and  clutter  effects  of 
display-related  remnant 

•  Expected  results  are:  definition  of  an  integrated  display 
for  helicopter  IFR  approach  with  acceptable  workload  and 
sufficient  excess  control  capacity. 
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GLOSSARY  OF  SOME  TECHNICAL  TERMS 
USED  IN  THIS  REPORT 


Axis  (Axes)  of  Control  -  The  manipulated  variable(s)  or  control  variable(s) 
acted  upon  by  the  controller  in  a  tracking  task;  the  control 
point(s)  in  a  system. 

Coherent  Error  Spectrum  -  The  pover  spectral  density  of  that  portion  of  an 
error  signal  which  is  correlated  with  the  forcing  function  or 
command  input  to  the  system. 

Controlled  Element  -  That  part  of  a  system  to  be  controlled  whose  parameters 
are  usually  unalterable  by  the  display  designer;  the  "pla..t'  . 

Controller  -  That  part  of  a  system  which  implements  a  control  law. 

Critical  Tracking  Task  -  When  the  rate  of  divergence  of  an  unstable  controlled 
element  is  gradually  increased  until  control  is  lost  on  the  sub- 
critical  tracking  task,  the  task  is  said  to  be  at  its  "critical" 
limit  of  divergence}  or  "critical"}  for  brevity. 

Cross -Adaptive  (Subcritical)  Tracking  Task  -  A  subcritical  tracking  task 

which  includes  means  to  measure  functions  of  one  or  more  variables 
in  a  separbve  but  simultaneous  task  and  which  uses  such  measure¬ 
ments  to  adjust  the  rate  of  divergence  of  the  subcritical  controlled 
element;  also  called  cross -coupled  subcritical  task. 

Crossover  Frequency,  -  The  frequency  at  which  the  decreasing  amplitude  of 
the  open-loop  frequency  response  becomes  equal  to  unity  with 
increasing  frequency.  The  name  "crossover"  derives  from  the 
connotation  that  the  desirably  large  but  decreasing  amplitude  of 
the  open- loop  frequency  response  "crosses  over"  unity  to  very 
small  values  at  this  frequency.  The  characteristics  of  the  open- 
loop  frequency  response  in  the  neighborhood  of  the  crossover 
frequency  are  of  fundamental  importance  in  the  analysis  of 
closed-loop  manual— as  well  as  automatic— control  tasks. 

Crossover  Model  -  An  approximate  representation  of  the  open-loop  frequency 
response  which  is  valid  in  the  neighborhood  of  the  crossover 
frequency. 

Describing  Function  -  An  operational  (mathematical)  description  of  that  part 
of  a  non-linear  controller's  output  which  is  linearly  correlated 
with  the  input  to  the  controller. 

Display  Content  -  Ihe  specific  elements  of  display  which  are  actually  preeent 
and  which  are  required  for  guidance  and  control  of  a  taek  or  are 
required  for  monitoring  task  performance  and  dec is ion -making. 

Display  Format  -  The  symbolic  cede  by  which  each  member  of  the  display  ccmtcut 
can  be  identified. 
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Display  Ratings  -  Subjective  pilot  opinion  ratings  of  a  manual  control 
display  based  on  psychometric  scales  of  "control] ability 
and  precision,"  "status  utility,"  "clutter,"  axid  "atr.entional 
demand" . 

Dither  -  In  the  context  of  tracking  control,  a  voluntary  quivering  of 
the  manipulator  by  the  pilot  at  1  to  3  Hz.  (Cf.  Tremor.) 

Dwell  Fraction,  Effective  -  The  foveal  dwell  fraction  increased  by  the 
cumulative  effect  of  parafoveal  perception. 

Dwell  Fraction,  Fo/etl  -  The  proportion  of  all  available  time  spent 
looking  nt  a  particular  object  of  fixation;  probability 
of  fixation. 

Dwell  Interval  -  The  time  duration  of  a  particular  foveal  fixation. 

Effective  Low  Frequency  Phase  Coefficient,  a  -  The  effective  low  frequency 
phase  coefficient  in  the  extended  crossover  model  represents 
the  influence  near  the  crossover  frequency  of  very  low  frequency 
lead-lag  dynamics  with  amplitude  ratio  break  points  which  are 
below  the  measurement  bandwidth  in  many  experiments. 

Effective  Time  Delay,  Te  -  The  algebraic  sum  of  the  pure  reaction  transport 
delay  and  high  frequency  neuromuscular  dynamics,  equalization 
characteristics,  and  (sometimes)  controlled  element  dynamics 
which  are  sufficiently  high  In  relation  to  the  unit-amplitude 
crossover  frequency  that  each  contribution  can  be  represented 
by  a  pure  del sy  near  the  crossover  frequency. 

Elements  of  Display  -  Porcino;  Functions  or  Command -Input  Signals,  i 

Controlled  Element  State  Variables  or 

Output  Motion  Signals ,  m 
Error  Signals,  e  ■  (i  -  m) 

References  or  Background 

Ensemble  Average  Value  -  The  arithmetic  mean  of  a  collection  of  discrete 
numerical  values. 

Equalization  -  Purposeful  alteration  of  an  open-loop  frequency  respon'**  to 
achieve  the  best  compromise  (in  the  crossover  frequency  region) 
between  high  gain  over  the  input  bandwidth  and  low  gain  beyond 
the  input  bandwidLV 

Equalization  Remnant  -  A  form  of  remnant  eittributable  to  the  generation  of 
low-frequency  lead  equalization  by  the  human  operator. 

Error  Coherence  -  The  ratio  of  the  mean-squared  input -correlated  error 
power  to  the  total  mean-squared  error  power.  It  is  the  com¬ 
plement  of  relative  remnant  referred  to  the  error. 

Feedback  Selection  -  Tho  technique  of  equalization  whereby  " inner"  loops 
which  are  subsidiary  to  the  "outer"  or  task  loops  are  intro¬ 
duced  . 


Feed -Forward  Control  -  A  control  law  specified  in  terms  of  only  forcing 
functions  or  command -input  signals,;  pursuit  control. 

Foveal  Perception  -  "Seeing  where  you  are  looking";  seeing  that  upon  which 
one  is  fixating;  or  seeing  the  (object  of  the.)  eye-point-of- 
regsrd  (SPR). 

Gain  -  The  low  or  high  frequency  asymptotic  amplitude  of  a  frequency  response 
to  an  input;  if  unqualified,  usually  means  low  frequency  asymptote 
except  in  the  case  of  a  washout. 

Loop  Gain  -  The  low  or high  frequency  asjrmptotic  amplitude  of  sn  open-loop 
frequency  response;  if  unqualified,  visually  means  low  frequency 
asymptote. 

Incoherent  Error  Spectrum  -  The  rower  spectral  density  of  that  portion  of 

an  error  signal  which  is  uncorrelated  with  the  forcing  function 
or  command  input  to  the  system;  the  frequency  distribution  of 
uncorrelated  error  power. 

Injected  Error-Remnant  3ource  -  When  mean-squared  values  of  signals  within 

control  loops  are  of  prime  interest,  the  remnant  can  be  satisfac¬ 
torily  represented  by  a  signal  source  having  a  specified  power 
spectral  density  injected  into  the  closed-loop  system.  When 
considered  as  an  injected  signal,  the  point  of  application  of 
the  remnant  can  he  transferred  from  the  pilot's  output  to  the 
pilot's  input  or  error  signal  as  long  as  no  nonlinear  elements 
are  passed  in  the  process  of  transfer ral.  At  low  frequencies 
the  remnant  data  for  a  wide  variety  of  controlled  elements  coalesce 
best  when  all  of  the  remnant  is  injected  at  the  pilot's  input 
cr  error  signal.  (Cf.  Observation  Remnant.) 

Integrated  Display  -  A  complete  combined,  connected  or  collective  presenta¬ 
tion  to  the  pi3.ot  of  the  proper  signals  for  ccntrollitig  as  well 
as  monitoring  the  performance  of  a  task.  The  adjective  "proper" 
applies  to  equalization,  scaling,  codification,  and  consonance 
in  ways  hypothesized  by  the  theory  of  manual  control  displays. 

Interrupt  Fraction  -  The  complement  of  the  dwell  fraction. 

Link  Values  -  (Transition  Link  F robabilitj.es)  -  The  proportion  of  the  number 
of  all  possible  fixation  transitions  which  occur  between  pairs 
of  objects  of  fixation:  link  values  may  be  one-way  (in  one 
direct <  -'ll)  or  two-way  (the  sum  of  both  one-way  values  between 
a  pair  of  objects.) 

Look  Fraction  -  The  proportion  of  the  number  of  all  possible  fixations  which 
are  directed  r,o  a  particular  object. 

Loop  Jlosure  (or  Feedback  Control  Loop)  -  A  control  liw  specified  in  terms 
of  controlled  element  state  variables  or  output  notion  signals, 
which  are  compared  with  input  signals  in  such  a  way  that  the 
difference  sigeal  can  bo  used  xn  the  controller;  compensatory 
control. 


T8  183-2  Ml 


Loop  Gain  -  The  low  or  high  frequency  asymptotic  amplitude  of  an  open-loop 
frequency  response;  if  unqualified,  usually  naans  low  frequency 
asymptote . 

Gain  -  The  low  or  high  frequency  asymptotic  amplitude  of  a  frequency  response 
to  an  input;  if  unqualified,  usually  means  low  frequency  asymptote 
except  in  the  case  of  a  washout. 

Theory  of  Manus]  Control  Displays  -  A  verbal-analytical  theory  for  predicting 
the  displayed  variables,  controller  behavior  and  control  technique, 
and  measures  of  performance  and  workload  for  pilots  of  manually 
controlieu  vehicles.  The  theory  is  based  on  the  notion  that 
display  design  is  fundamentally  a  guidance  and  control  problem 
which  has  interactions  with  our  knowledge  of  human  psychomotor 
activity. 

Observation  Remnant  -  Noise  caused  by  poor  coupling  between  the  displayed 
signal  and  the  eye.  Observation  remnant  includes  scanning 
remnant  in  multidisplay  control  tasks,  (cf.  Injected  Error- 
Remnant  . ) 

Parafoveal  Perception  -  "3eeing  without  looking";  seeing  that  upon  which 
one  is  not  fixating;  or  seeing  that  which  is  outside  the  eye- 
point-of ^regard  (EPR) . 

Power  Spectral  Density  -  The  frequency  distribution  of  the  square  of  the 
amplitude  of  (a)  the  (complex)  Fourier  coefficients  of  a 
periodic  function  or  (b)  the  Fourier  transform  (if  it  exists) 
of  a  non-periodic  function.  The  power  spectral  density  of  a 
random  process  is  the  mathematical  expectation  of  the  power 
spectral  densities  of  the  individual  functions  comprising  the 
process. 

Quasi -Linear  Pilot  Model  -  A  verbal-analytical  describing  function  of  a 
class  of  human  pilot  behavior  with  remnant. 

Reaction  Time  Delay  -  A  pure  transport  delay  due  to  sensor  excitation 
(the  retina  in  the  visual  modality;  the  semicircular  canals 
and  utricles  in  the  vestibular  modality,  for  examples ) ,  nerve 
conduction,  computational  lags,  and  other  processing  activities 
in  the  central  nervous  system.  It  is  closely  related  to,  but 
not  identical  with  certain  kinds  of  classical  reaction  times. 

Reconstruction  (from  the  Sampled -Data)  -  The  extrapolation  of  a  continuous 
signal  from  discontinuous  observations  or  samples  of  data. 

Relative  Remnant  (i-sferred  to  the  Error)  -  The  ratio  of  the  near1  -squared 

uncorrelated  error  power  to  the  total  mean-squared  error  power. 

It  is  the  complement  of  the  error  coherence.  If  so  design  ted, 
relative  remnant  can  also  be  referred  to  a  control  point. 

Remnant  -  That  pert  of  a  non-linear  controller’s  output  w^'ch  is  not  linearly 
correlated  with  the  input  to  the  controller. 
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Remnant  Error  Spectrum  -  The  power  spectral  density  of  an  injected  error- 
remnant  source. 

Injected  Error-Remnant  Source  -  When  mean-squared  values  of  signals  within 

control  loops  are  of  prime  interest,  the  remnant  can  he  satisfac¬ 
torily  represented  hy  a  signal  source  having  a  specified  power 
spectral  density  injected  into  the  closed-loop  system.  When 
considered  as  an  injected  signal,  the  point  of  application  of 
the  remnant  can  he  transferred  from  the  pilot's  output  to  the 
pilot's  input  or  error  signal  ao  long  as  no  nonlinear  elements 
are  passed  in  the  process  of  transferral.  At  low  frequencies 
the  remnant  data  for  a  wide  variety  of  controlled  elements  coalesce 
test  when  all  of  the  remnant  is  injected  at  bhe  pilot's  input 
or  error  signal,  (cf.  Observation  Remnant) 

Saccade  -  The  quick  movement  of  the  eye  hy  which  the  gaze  is  transferred 
from  one  fixation  point  to  another. 

Sampled  Data  System  *•  A  system  in  which  at  least  one  signal  is  observed 
discontinuously  at  random  or  systematically. 

Scanning  Interval  (Look  Interval)  -  The  elapsed  time  between  the  start  of 
successive  foveal  fixations  on  a  particular  object. 

Scanning  Remnant  -  A  form  of  remnant  attributable  to  foveal  scanning  by  the 
human  operator. 

Separated  Displays  -  l  multipartite  collection  or  arrangement  of  distinct 
individual  or  disparate  displays  or  instruments  having  at  lfc83t 
a  task  or  controlled  element  in  common. 

Subcritical  Tracking  Task  -  An  unstable  controlled  element  which  can  be 
stabilized  by  a  loop  closure. 

Symbol  Density  -  The  relative  proportion  of  the  total  displayed  field  of 
view  which  is  occupied  by  members  of  the  symbolic  format 
exclusive  of  the  background  element. 

System  -  A  collection  of  interconnected  physical  devices  or  mathematical 
operations . 

Tremor  -  In  the  context  of  tracking  control,  the  involuntary  quivering  of 
the  manipulator  contributed  by  the  neuromuscular  system  at 
10  to  15  Hz.  (Cf.  Dither.) 

Washout  -  A  dynamic  frequency  response  function  having  no  response  whatso¬ 
ever  to  a  static  input. 

Weber-Law  Errors  -  Deviations  from  the  linearity  of  stimulus -response 

relationships  in  accord  with  the  Weber-Fechner  law.  The  law 
asserts  that  equal  increments  of  sensation  are  associated 
with  equal  increments  of  the  logarithm  of  the  stimulus. 

Zero-Order  Hold  -  A  type  of  continuous  signal  re>. instruction  from  samples 
of  data  whereby  the  value  of  each  observation  is  held  constant 
until  the  next  sample  is  taken. 
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A  theory  of  displays,  wptbJ:  with  validated  tschaiquss  for  eaaly&log  dceed-loop  pllot-vebiola  dy- 
rstaio  perfor*sac«,  provides  a  systematic  procedure  for  improving  tte  goidutce  sad  control  display  dssign 
process.  Central  to  this  theory  is  ths  notion  thnl  display  dssiga  la  fundamentally  a  guidance  and  control 
problem  vhioh  2ms  dntaraotlecs  with  cur  lowwledge  «f  human  psychoootor  activity. 

Za  outlinlrg  the  prirolpiea  of  this  analytic  rpproacb  to  display  design,  vs  ravlev  tbs  i aspirations  for 
ays  aorsmnt  atvliaj  lo  flight  control  snd  mnltc^rlag  tasks  end  stasarU*  tha  relationship  of  eye  scanning 
phsnaama  to  pilot  dascrlblng  function*  end  resusr.t.  Several  aesdurps  of  pilot  vorklcad  In  control  tasks 
are  discussed.  Ooo  aeaaure,  In  particular,  haa  (treat  premise  In  quantifying  a  practical  definition  of  wife* 
load.  ?hif  is  excess  control  capacity.  It  Is  a  arjor  workload  connector  with  pilot  opinion  rat  ins  and 
whole-task  effective  tlae  dr/lay.  W*  conclude  bj  Ulustrsting  the  further  ccnaacticns  vlth  lead  equalisation, 
scanning  vorkload,  physiological  atasurss  of  neurosuscplar  tins  ion,  snd  ths  effects  of  additional  modalities 
on  visual  vorklccd. 


acwaucggi 

She  design  of  guidance  and  control  displays  vhlcb  properly  interface  vlth  the  pilot  and  the  centre], 
ays  tea  of  a  nev  aircraft  or  spacecraft  la  often  hsacd  on  Intuition  and  tradition  backed  by  a  qualitative 
understand li«  of  the  potentially  useful  control  information.  Instruscnt  arrangements,  Integrated  display 
formats,  tad  flight  director  system  an  selected  using  this  backgrotnfl  end  experience  end  ore  then  sub¬ 
jected  to  exhaustive  and  often  expensive  development  snd  coupon* on  In  simulators  end,  ultimately,  in  flight. 
Bn  simulation  process  usually  reveals  shortcomings  In  the  preconceived  d lap?, ay  syatone  vhloh  are  overseas 
by  progressive  aodlflcatlon,  retesting,  reevaluation  and  reasseusaant.  This  procedure  1*  often  tlme- 
cons  using  and  costly.  Until,  recently,  however,  It  bee  been  entirely  wceesary  for  neleotion  of  the  best 
coatprooioe  display  system. 

a  theory  for  galdsac-e  and  control  displays  (e.g.  Ref.  1  end  2)  together  vlth  validated  techniques  for 
analysing  elated-loop  pilot -vehicle  dynamic  perfonasnee  (e.g.,  Ref.  3  and  fc)  nov  pro  rides  the  naans  for 
considerably  Improving  the  display  design  process.  A  first  step  in  the  application  of  the  theory  is  to 
translate  the  verbally  understood  purposes  of  a  guidance  and  control  display  syatcr*  Into  atcr#  specific 
exglncsrliv  terns.  Tor  tbs  display  designer,  this  first  step  has  been  nost  difficult.  Although  he  nay 
essusv  that  Insattv  unreliability  Is  related  to  voxfeloed,  he  can  only  verbally  qualify  vorkload,  because  ho 
docs  not  presently  hove  a  quantifiable  expression  of  the  penalties  associated  vlth  human  errors  In  perfor- 
nar.oe  vhlcb  Is  comae  ns ’-rate  vlth  ths  cuctomsry  perforntnee  satrlcs  of  mission  nuccoao. 
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fftatad  bromUy,  tbs  purpose  of  a  nev  guldwes.end  control  display  afatew  should  he  to  improve  piloted 

oysten  performance  to  a  point  vbere  at  leust  a  eubset 
or  even  ths  whole  eet  of  oleslon  re qui rewrite  can  be 
•atlsfled.  In  eye  tea  engineering  tens,  the  Improve - 
cent  of  performance  implies  greater  frequency  band* 
widths  and  correspondingly  reduced  closed-loop  system 
lags  and  errers  in  following  cocnanda.  It  sic o  luplioc 
improved  suppression  of  the  effects  of  external  distur¬ 
bances.  In  terms  <*f  pilot  behavior  the  improvement  of 
performance  implies  reduced  effective  tine  delay; 
reduced  pilot-induced  noise  insertion  (unwanted  control 
action);  Increased  allowable  range  of  pilot-gain  var¬ 
iation  consistent  vitb  closed-loop  ay*tes«  stability; 
and  reduced  workload  to  a  level  where  tw  is  efficiently 
snd  gainfully  occupied,  yet  able  to  cope  to  a  pre¬ 
scribed  decree  with  the  unexpected. 

for  example,  tlie  pro'otype  £ero  Header ®  flight 
director,  like  its  counterpart,  the  automatic  pilot, 
inspired  eve  rather  than  confidence  in  professional 
pilots,  because  it  failei  to  display  the  confidence- 
inspiring  situation  or  st  ,tu»  information  to  vhlcb 
pilots  have  always  been  accustomed.  Slice  the  pilot 
still  want  to  bis  aeparate  displays  for  status  infor¬ 
mation,  uso  of  the  prototype  flight  director  for 
guidance  wrv?  control  seemed  to  be  ar  extra  task.  Many 
experiments  (Ref.  5-8)  have  proved  that  the  contemporary 
integrated  flight  director  can  and  does  improve  over-all 
eyste*  performance.  However,  even  without  eigniflcent 
performance  improvement  (sometime*  difficult  to  measure 
experimentally)  the  flight  director  system  ehould  al¬ 
ways  make  the  pilot's  Job  easier.  That  is,  it  should 
reduce  hie  vorkload  from  that  required  to  psrfora  tu 
tafk  us!ug  normal  cockpit  ir  trumontatl*:^*  *uls  in** 
elude*  t?och  tfce  scanning  vorkload  wad  tbe  perceptual 
workload  required,  e.g.,  for  pilot  G*"»ra«eB  of  low 
fsgure  t.  Vypieal  Bye  fixation  .>*B3lU«5  Uah  frequency  aqualuattoa.  The 

rectors  sad  TmH  fraction  t&asured  ta  ClswJteted  i®  ^fweed  pUot  rating  eRrncity 

,T»t  ?wjort  XsKttruwtat  kvpicemal&a  display  ®»J  incivaa. 
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for  coping  with  unexpected  workload. 

An  exaapAs  of  the  reduction  In  setsolag  workload  [ersapllflud  Sr  transition  IlaX  vector*  to  and  fro* 
cod  Avail  fraction  cn  the  Eorisontal  Situation  Xx-llcutor/ililA*  Slope  Display  (S3I/G3I)))  obtained  with  a 
flight  director  prearot^tlon  can  to  found  In  Rai’.  2.  Figure  1  (frem  Rat.  6)  la  Included  law  to  snow  tbs 
ehaagaa  In  soasni^  workload  (the  fraction  of  total  tint  spent  on  tech  instrument  la  Indicated  tbsrsoa)  is 
going  frex  a  manual  Efl  task  (top  fl^uro)  to  a  fligat  dlrsctor  configuration  (lower  figure).  Shis  vxrm- 
ticcU.  flight  director  conflgurstloa  vsa  also  wad  In  preliminary  simulation  studies  psrxormd  at  8EC 
utilising  the  results  of  tbs  adr.ocefl  flight  director  design  program  of  Ref.  ?.  In  the  edvaaerd  director 
system  derived  from  the  study,  «  pilot  lead  oqualisetloo  (as  predicted,  ml  measured  is  the  simulator  Sy 
pilot  deiwrltlng  fuarticca)  was  .squired.  fiw  simulation  miulta  shoved  on  lspcovsaunt  In  pilot  resting  of 
1  to  1  i/S  points  (fro*  3  1/2  to  8  on  the  Cooper  Scale)  and  .IsprevaS  gllleslopa  basa-followlng  perfonasnoe 
for  various  Inputs  ae  Indloctcd  In  Fig.  £. 


O  Advanced  Slrcotor 
□  Goaveutioc&l  Blrsctor 
Ho  night  Director 


0 

1“ 


RH3  Seeo  Xrror  frea  Oliki  Slope 


T 


T 

10 


k 

T 


i 

20 


ICO 


Random  Vertical  Curt  (r,h  a  3.3  ft/sec  (1.0?  m/s) 

- 1 — 

I  0 

- r — ? 

□  > 

- 5 - T~ 

Bttzi  Ccsmamd  (h,)  .  an  -  16.3  ft  (3.03  a) 

©□ 

!> 

Ho  XEgotj  Pilot  Hade  Xnteutloiml  !0-tt(y.15-ti/«) 

Br/sefi  Chsa«» 

.  © 

a> 

Seed  vied  Steer  13  kt/lO  scs  (7/fc  m/s/lO  sic) 

.  o 

□ 

0 

Step  Vertical  Oust  10  ft/seo  (3.03  a/s) 

-0 

a 

> 

Figure  2.  Simulated.  Hid#  Slope  Beea-Follciing,  Pp-feroancs  Oader  tfcaual  Control  with  Various  lapate. 


Kith  regard  to  It*  impact  on  closed-loop  oystem  performance,  end  pilot  workload,,  e  good  flight  director 
system  la  cocpetltlw  with  an  autosatle  flight  control  system.  In  fact,  for  Approach  in  CAT  I  and  IX  con* 
citrons  night  ai.wesors  offer  Ices  welgnt,  veijass,  and  power  penalties  and  arc  more  reliable  end  less  tuaily 
r.t  a  given  level  of  redundancy  than  tbwlr  autonetlc  equivalents.  Also,  flight  director  eye  tea  porfonaucc 
can  ha  easily  equal  to  that  of  automatic  systww  for  beta  ooauacd  following  and  disturbance  suppression 
for  certain  ether  input*,  such  os  overflights,  the  flight  director/pilot  oystea  perferaone*  any  he  superior 
to  that  of  a  fully  automatic  system.  Furtheraore,  the  flight  director  penults  hotter  utilisation  of  tho 
pilot  aou  cc. -pilot  In  their  normal  roles  us  active  cent  roller*  and  monitors  of  the  situation.  In  thie  vay 
they  ®r*  kept  In  the  loop  In  case  of  aircraft  or  system  failures.  However,  assuring  aa  autocratic  flight 
control  system  is  i retailed  and  used,  an  additional  purpose  of  the  flight  director  is  to  provide  on  overall 
Monitor  on  the  automatic  aystea's  performance  both  to  Instill  t  —idence  in  the  pilot  end  to  permit  bin  to 
!*><•  over  In  cate  of  eysten  calf  unction. 

The  extent  to  which  Iti  above  purposes  are  actually  accomplished  defines  ths  "goodness”  of  en  Integrated 
flight  director  eye  tea  es  an  -xaspln  of  a  guidance  aod  control  display.  Having  expressed  tha  purposes  of 
display  design  In  systems  scglneenog  terms,  wo  c*a  apply  an  analytical  design  approach  Wh  as  that  lllra- 
trated  in  Kefs.  2,  f  end  10.  In  what  follows,  we  shall  only  ho  able  to  suaatrito  the  principles  of  thio‘ 
approach  to  display  design.  By  means  of  thie  aualytlcsl  approach  we  coo  achieve  a  juantltatlve  understood’ 
lag  of  tha  lpteraetl.as  rang  tha  pilot,  the  display  system  and  the  vehicle.  Putting  this  understanding  to 
work  ;filX  then  whlcra  direct  and  Important  sarlnga  In  the  display  design  end  evsluaticu  process. 

psnBXPun  or  ourwaca  m  cotocl  sxshmt  vsqm 

iHsplny  design,  io  our  view,  lg  , fundamentally  pert  of  a  guidance  and  control  problem  which  has  inter¬ 
actions  with  our  knowledge  of  tenran  psycb<Wtor  activity.  Our  treatment  of  the  display -pilot -nirt  rail 
system  rests  on  three  fuaderental  bypot!  sues : 

1.  To  accomplish  quid  moo  ail  control  function/,,  such  as  flying  a  desired  track  in  tho 
presence  of  disturbance,*  aalnUUnlrg  precision  control  (a*  in  formations  or  refueling), 
flying  intercept/,  or  approaches,  etc.,  tho  human  pilot  eata  up  a  variety  of  cloaod-loops 
•bout  the  aircraft  which,  by  ituelf,  could  hot  otherwise  eccoapllch  tfceee  taaks.  In 
control  ayatciM  etclneeriag  terms  his  control  actions  aro  functions  of  deaired  end  octi;ol 
aircraft  motions. 

2.  To  he  satisfactory  these  closed-lotp  systems,  coeprU.ag  both  enisats  and  Irani  mate  com¬ 
ponents,  meet,  share  certain  of  the  crualitetive  dynaaic  failures  of  "good”  cioeud  -loop 
ayattoe  of  a  solely  icaniaate  nature.  As  the  adaptive  Bear*  to  wconpllab  thie  end, 
the  pilot  must  mm)"'  up  for  any  dyutaic  deficiencies  of  the  airersft  by  apprspriirte 
adjustments  of  his  dynamic  properties.  (Here  the  "airenft"  includes  the  display  and  controls). 

J.  There  la  a  cost  to  this  adjustment— in  workload-induced  strewa,  in  concentration  or 
pilot  faculties,  and  in  reduced  potential  for  copint  with  the  unexpected.  Thie  coet 
can  also  \o  iraied  for  tbs  cost  of  automatic  controls.  In  Baling  this  Ante-off,  ose 
may  allocate  part  of  tho  tscie  to  mrr.?al  and  part  to  automatic  control. 

To  apply  closed-loop  theory  one  rcuut  have  »oso  sind  of  model  to  describe  pilot  behavior.  Our  models 
have  evolved  from  slxpls  .single-loop,  fixed  bus  »,'.tu*tloas  to  represent  aultllohp  fixed  and  noviog  bos* 
scenarios.  Thay  erv  >ery  useful  prsilctli^  potential  handling  quality  problew  fo.  c#v  and  uaexjclorvi 
arses  sjj3  for  flight  control  systea/alrpleao  costol natlora  which  are  not  of  tbs  "claeil-el*  variety.  They 
css  mso  be  used  to  asaiyss  a^d  exolstjs  slmulatieu  resulti  after  tho  fact.  Tble  usefulness  has  lusr*u»4 
over  tf»  years  a*3  is  toO*y  fu?  ssvs  cooorrte.  0?e*  a  deceda  of  resefeoh  aad  ^pl^catija  (set  the  Blhllo- 
gs-*gfe/  ia  Ref.  k),  la  both  Assrics  sa3  ims  resulted  ia  models  of  pilot  behavic-r  that  ms  aiafe 

eoj-hirstlcsteS  i©3  thie&  eaa  be  used  te  Croat  very  cospies  «s»?ju»X  figist  cuatrol  problass.  o»  yl  *™ 
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■israselc a  do*  exist  which  csn  be  used  to  p/edlctt 

1  •  tim  displaysd  variables  and  control  display  assoolatloos  required  for  tbs  task  from 
tb»  likely  loops  oloaad  by  tbs  pilot  to  ocweplish  a  given  task  (i.o.,  inatroranta  used 
in  ITB,  visual  outs  In  FIR)) 

8.  5S»  dynsalo  bfbarlor  required  of  tba  pilot  (a.g.,  dasorlblsg  functions),  and  banco  tbs 
piloting  techniques  exhibited  In  tbs  given  tasks  for-  fixed-base  operations) 

J.  Effects  of  certain  actions  on  the  pilot  dynnle  behavior  lncludlrg  cuss  to  be 

utilised  or  Ignored) 

%«  Cloeed-locp  systea  perfonsaoce; 

5*  Pilot  aoannVtry  and  ratings) 

6.  Excess  manual  control  capacity,  i.e.,  aaaaures  or  task  vorkload  or  additional  workload 
tbst  could  be  acconpliabsd)  preferred  combinations  of  displayed  variables  which  are 
caipetible  with  tba  physical  acanulrg  vorkload  constraint. 

7*  8cm  patterns  (for  IFR)  Including  proportions  of  tins  spent  on  each  instrument  and 
link  probabilities  from  instrument  to  Instrument. 

Phis  la  a  wry  impressive  list,  but  we  cbould  note,  of  course,  that  not  every  Icon  co  It  can  be  predicted 
with  equal  confidence,  largely  because  of  the  differences  la  the  underlying  empirical  bases.  Consequently, 
while  estimates  can  be  made  for  everything  listed,  the  degree  of  precision  In  these  estimates  will  vary. 
Vonetbaleas,  tbs  point  to  wish  to  make  la  that  ell  of  tbase  things  can  be,  end  hove  Wan,  done,  they  are 
very  useful  for  preliminary  design  analysis,  for  prediction  of  key  problems  In  novel  situation.,  for  exper¬ 
imental  planning  »z6  guidance,  an 5  for  the  Interpretation  experimental  results. 

Remarkably,  tbs  theory  Is,  generally  speaking,  fur  more  advanced  than  the  usual  measurements  practiced 
In  experimental  simulation,  these  are  nomuly  baaed  on  a  state  of  art  appreciation  which  la  at  least  a 
decade  behind  the  appreciation  afforded  by  dedicated  closed  -looj  analyses.  Often  tbs  only  measures  token 
are  system  performance  and  pilot  rating.  Such  measurements  can  at  beat  giro  only  a  gross  smoothed-over  slew, 
fbsy  are,  of  course,  enormously  useful  In  deteralnlc^  whether  a  particular  systea  Is  satisfactory!  but  they 
X»a»a  much  to  be  desired  In  determine  the  causes  and  correction  for  difficulties  except  by  ad  boo  adjust¬ 
ments  which  may  bs  isnduly  Influenced  by  "artificial*  Simula* loo  characteristics.  We  bellevu  that  many  of  the 
complexities  which  devolve  from  the  huresm  pilot's  presence  are  now  a  proper  end  useful  subject  of  ongineerit® 
«Maly*-S.  S>is  view  la  amply  supported  by  the  reports  end  papers  listed  In  tha  Bitlicgrcphy  in  Ref.  k. 

Ve  shall  now  turn  to  a  brief  discussion  of  some  principle*  at  the  fringe  or  lov-confideuce  aide  of  the 
theory,  lhtse  are  display  sampling  and  scanning,  and  workload  aaieesmenta. 

XESFnusroRh  for  ete  hdvqctt  Mrora  nr  TiAim  conrooL  m  kbkitoriko  iasxs 

She  Ksaaurement  of  pilots’  eye  fixations  and  movement*  about  the  lnetruaent  panel  within  the  cockpit  has 
attracted  research  for  over  a  quarter  of  a  century  (e.g..  In  Ref.  10,  see  Ref.  67-77,  824)5,  95,  and  96). 

Hut  lurprisingly,  toe  motivation  for  the  earliest  available  results  scene  to  have  been  to  compare  pilot 
fatigue  under  instrument  flight  rules  Induced  »y  differences  In  "scanning  workload*  among  instruments  bst- 
wvsn  tbs  Standard  (circa  19ka)  Army  Air  Fore*  and  Royal  Air  Fore*  Instrument  panels.  So  explain  statistic¬ 
ally  significantly  dlff.rsnt  experimental  .exults  on  tba  two  different  panel  arrangements,  an  embryonic 
display  arrangement  hypothesis  was  sat  forth  In  19hbi  "Differences  betweon  the  time  spent  on  the  venous 
loatriMnte  In  the  tv-  panel  arrangement!  may  be  explained  by  the  hypothesis  that  pilots  tend  to  .pend  more 
time  on  the  centrally  located  Instrument*,  and  particularly  on  the  instrument  located  In  the  top  center 
position,  while  not  definite,  ttua  finding  suggests  that  iustrussnt  panel  designs  should  place  the  mote 
Important  instrument  for  Instrument  flight  In  the  top  center  position  of  the  panel,  and  the  next  mort  impor¬ 
tant  Instrument  In  tba  lover  center  position."  (From  Ref.  67  in  Ref.  10) 

C-ber  earl.'  studies  of  eye  movement*  of  flight  personnel  were  concerned  with  open-loop  signal  detection, 
for  example,  seorchlr^  for  targets  on  radar  scopes,  monitoring  multi-engine  performance  for  threshold- 
erceedence-,  and  establishing  minima  visual  angles  external  to  the  cockpit  under  visual  flight  rules. 

However,  the  inspiration  for  much  of  this  eye  movement  work  wee  founded  on  the  belief  that  the  cues  used 
by  the  pilot  In  controlling  flight  would  be  revealed  by  noting  the  (separated)  instruments  upon  which  the 
fovea  of  the  eye  was  fixating  Inside  the  cockpit  under  instrument  flight  rules,  sud  by  correlating  the  dir¬ 
ections  of  fixations  external  to  the  cockpit  with  significant  ground-based  cues  in  landing  approaches  under 
visual  i light  rules.  Information  about  the  useful  instrument  flight  control  cues  was  believed  to  be  funda¬ 
mental  to  an  understanding  of  the  function  served  by  flight  lnstrumtnts.  It  vsa  expected  that  this 
moderatund-ug  would,  in  turn,  fora  a  basis  for  improving  the  design  of  aircraft  instruments,  increasing  the 
efficiency  of  Instrument  flight  training,  and  simplifying  the  task  of  Instrument  flying. 

Today  ve  are  atlW  working  to  fulfill  this  expectation,  because  the  premise  on  which  it  was  founded 
twenty  years  ago  has  been  shown  to  be  only  a  partial  truth  for  several  reasons.  Pilots  develop  an  ability 
to  operate  effectively  on  parafovarJJy  and  peripherally  perceived  Information  (Ref.  11 ),  albeit  vlth  seme 
Unltatiwr  (Ref.  .2),  and,  of  course,  on  reinforcing  (i.e.,  nonconflicting)  aotlon  am  aural  cues.  Purthei, 
th*.«  la  c./Mldertble  Indirect  evidence  (e.g.,  Ref.  15)  that  in  "stare  mode"  circumstances  flxlig  the  eye- 
polnt-of -regard  serves  merely  to  stabilise  the  eyeball  for  good  parafoveal  viewing,  so  that  the  fixation 
point  may  be  unconnected  with  the  la'onaaticn  actually  used,  or  even  perceived,  by  the  pilot.  Ve  cannot  eay 
that  What  la  being  fixated  necessarily  correspond*  to  an  Input. 

Sh»  inspiration  for  the  earliest  pilots'  eye  movement  studies— that  scan  patterns  might  be  useful  for 
vorkload  mewaures— vaa  “wired  wore  recently  in  Ref.  Ik.  While  seen  patterns  are  indeed  relevant  to  workload, 
the  coeaect-ca  Is  nrt  simple.  Tv.  eye  requires  fixation  to  keep  the  eyeball  stable,  so  there  is  a  kind  of 
Parkinson's  tew  for  tba  cyehxll— tha  sum  o*  the  fixation  dwell  times  on  the  instruments  expanJs  or  contracts 
to  eguml  tbs  tire  available  laej-eotlug  s&oc  die  uimts).  There  is,  of  course,  s  minimum  dwell  tine  of  about 
O.b  sec  per  instrument,  sv  it  is  .to  contrive  saturated  conditions  where  Che  control  task  deaarde 

piX&v  fixstioew  oo  too  many  instruments  too  often  la  order  to  saint  sin  cortrul.  2ut  the  interpretation  <t 
such  result*  would  often  be  ambiguous  If  osw  la  lcokiac  for  the  pilot'*  Input*. 

p-a  eajly  -jye  sovewsut  utsdies  refereswsd  gbov-  eosajidered  fixatic-sa  ee  a  function  of  tbs  ove.ell  pllot- 

systea  teak,  se  ladles  espseaoh,  but  oospleteiy  ep«r t  f«vs  U»  coatrolied  *X@s«ai  -i. '.c . 
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So  set  ct  ttm  tots*.  "pUotAbtUty*  prcblaa  ea  prcj  -sad  some  y**rs  ego  Hurt  pilert-&ir«r*«  eystea  dyasaio 
tceiml^as  ba  applied  to  tt»  display  area.  Coder  coordinated  HA2A-ARC  cad  JABAXB  sponsorship  vs  bars  la  the 
last  four  years  developed*  wflosd,  scd  elaborated  a  theory  (Refe.  a,  10  sad  13)  silled  it  to  a  member  of 
interesting  eltoatlcoe  (Safe.  2(  13  sad  16),  ead  hare  supported  and  augsanted  the  tlsoretieal  devalepasnt  ia 
crucial  areas  vith  akpsriwntal  efforts  (Refs.  6,  16  aad  17). 

8CA23BO  TESmZA  SO  33  ESCttBSP 

Basldea  laatruasnt-to-instruasnt  scene,  aeacnlag  occurs  between  elements  within  eosblced  or  Integrated 
•yifcollc  ead  pictorial  displays.  for  sxnsple,  secondary  fixation  trensitioao  within  tbs  ivo-exis  attitude 
director  00  various  oyriola,  Indices  and  scales  have  been  observed  la  tbs  experiments  of  Bef.  6.  Among 
several  pictorial  esaaples  of  pilot’s  actanlsg  patterns  on  different  instrument  panel  arrangeasnts  In  Raf.  ’3, 
there  la  shown  on  Internal  pattern  on  an  Integrated  contact  analog  display.  Obviously,  one  east  speak  of  a 
fore  si  scanning  pattern  asosg  "eyi&ola"  In  the  csss  of  the  contact  analog  or  soma  other  Integrated  display, 
rather  than  among  "Instruments"  as  va  shall  do  In  aoot  of  vfcst  follows, 

rurtheraori,  an  observable  foveal  aosamiag  pet  tern  ssy  be  accompanied  by  a  parafoveal  scorning  pattern 
of  searanesa  which  Is  not  directly  observable  by  oe enuring  eye  cerements.  Eovever,  tbs  presence  of  parafoveal 
awareness  la  indirectly  observable  by  its  Influence  on  the  pilot's  describing  function. 

Although  ve  eJvJLl  bs  speaking  prlaarlly  about  the  visual  eodallty,  the  pilot  can  also  choose  to  use  or 
ignore  notion  and  aural  cues.  Vhllo  this  is  not  quite  like  sampling,  tbs  sore  or  less  continuous  use  of  tbs 
vestibular  or  aural  sodality  ia  skin  to  a  process  of  selaotlon  when  these  cues  reinforce  the  visual  modality. 

The  proportion  of  the  total  maker  of  fixations  which  fall  upon  a  particular  Instrument  is  called  the 
average  look  fraction  for  that  Instrument.  Its  uppei  bound  i^i  one-half,  which  implies  that  every  other  fix¬ 
ation  or  look  is  on  that  Instrument  having  a  lock  fraction  equal  to  oas-half. 

She  proportion  of  the  total  time  during  which  fixations  dwell  on  a  particular  Instrument  Is  called  the 
average  dwell  fraction  for  that  UStrusent.  Since  the  cumulative  am  of  all  dwell  fractions,  including  blink* 
and  distractions,  gust  equal  unity,  by  definition,  the  dwell  fraction  la  also  termed  "fractional  acanalng 
workload"  or  "probability  of  fixation." 

Tbe  proportion  of  all  fixation  transitions  which  go  in  the  same  direction  between  a  pair  of  Instruments 
(arrows  in  fig.  1)  Is  called  the  "one-way  link-value"  In  the  specified  direction.  The  sun  of  the  two  one-way 
link-values  between  a  pair  of  Instrument*  is  called  the  "two  way”  link  value.  In  195R,  new  research  extended 
the  display  errangenent  hypotheslu  of  19&  to  suggest  that  the  pattern  of  link  value a  between  instruments  la 
Indicative  of  tbe  goodness  of  different  panel  arrangements.  Since,  In  point  of  fact,  the  scanning  statistics 
ore  quite  stationary  *  nr  measurement  Intervals  as  short  u  100  sec,  different  one  vay  link  values  between 
the  se=e  pair  of  instruments  are  also  Indicative  of  determinism  In  scan  patterns.  Tbe  results  In  Bef.  6  show 
no  evidence  of  circulatory  determinism  in  (canning  traffic.  This  simplification  proves  useful  In  making 
predictions1  of  scanning  behavior. 

HJLKA3QB  0CC2TU3  tdCUS  FOR  HBCMBUH  HEKXI08  Aid)  R2M1AKT  PEZRCKSHA  ACCOKPAfflBIO  3CAH1CK0 

As  far  as  va  can  tell  currently,  we  have  not  discovered  a  unique  relationship  between  observable  foveal 
scanning  statistics  cad  the  accompanying  pilot’s  describing  function  and  remnant.  Instead,  we  have  two 
different  Halting  forms  for  mtuxlloop  pilot  models  in  control  *«sks.  In  experiments  In  Refs.  11  and  17,  the 
pilot's  describing  function  dynamics  la  closing  tbe  several  loops  are  not  much  degrade  with  additional  time 

delays  because  of  the  scan,  although  the  pilot  gains  are 
reduced  frees  those  that  would  be  expected  on  a  single- 
loop  basis,  and  the  foveal  Input  Information  samples  are 
obtained  from  a  finite  dwell  period  with  an  average 
minimum  dwell  time  of  about  0.4  aec.  This  la  not  whan 
one  would  obtain  with  a  simple  zero-order-hold  aampied- 
datn  system,  so  the  sampling  and  scanning  theory  required 
to  describe  the  pilot's  eye  movements  has  been  quite 
elaborate. 

Vltb  these  empirical  facta  as  starting  points,  two 
likely  mental  processes  have  been  proposed  (Ref.  17), 
called  the  "switched  gain"  model  and  the  "reconstruction- 
hold"  model.  For  the  switched  gain  process  the  quasl- 
linesr  describing  functions  in  the  several  loops  incur  no 
time  delay  because  of  the  scanning  and  sampling  processes, 
although  the  gain  switching  (multiplexing)  from  loop  to 
loop  reduces  the  effective  gain  in  each.  In  the  recon¬ 
struction-hold  model  a  sampling  delay  is  Incurred,  but 
may  be  largely  offset  by  lead  equalization  as  part  of  the 
signal  reconstruction  process,  which  tends  also  to  restore 
part  of  the  average  loop  gain  loet  in  the  sampling  process. 

Tbe  principal  cost  of  thu  scanning,  sampling,  and 
reconstruction  (or  switching)  behavior  la  an  increased 
"resmant.”  This  depend#  on  the  sampling  frequency,  fix¬ 
ation  dwell  time,  and  sampling  frequency  variations,  as 
well  as  tbe  signal  variance.  Since  the  hypothetical 
signal  reconstruction  process  attenuates  sampling  remnant, 
the  avitched-gain  model  viU  produce  relatively  more 
remnant,  if  other  variables  are  equal.  The  remnant 
represents  pilot  control  movements  which  are  Incoherent, 
i.e.,  not  linearly  correlated  (via  the  describing 
function)  with  the  externally  imposed  fort  ng  functions. 
Tbe  remnant  acts  like  an  injected  nolsa,  and  is  the  real 
cause  of  saturation  in  multi-instrument  displays.  So, 
m  ve  said  at  tbe  outset,  eeasureseut  of  eye  fixation 
is  certainly  connected  with  pilot  inputs  aid  workload 
but  tfc®  coa&eotioa  1#  by  eo  esess  eiv-pls 
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Aj  It  now  • tends ,  th#  theory  of  aultlul*  ■ canning  cm  be  uatd  to  eetlaet*  fixation  probabilities  m£. 
loetrumeot-to-lnetrument  link  probabilities  fairly  accurately.  Aa  an  example,  ri|,  3  ahowa  km  predlstloo* 
ud'  vlth  the  rscooetructloo-bold  varalon  of  tha  theory  (Aef.  10)  for  a  landing  approach  ueltg  Boelr*  707 
aircraft  dynamics,  aa  compared  vlth  uaaaureaanta  (fWf .  6)  mad#  imlng  tha  DC -8  landing  approach  a Imlatcr 
at  A*i  Research  Canter.  Tha  reaehblance  la  quite  good,  a  ape  cl  ally  conalderlng  tha  infant  atata  of  the 
theory  at  tha  time. 

This  conclude*  a  review  cf  tha  lnaplratlona  for  aye  movement  atudlaa  In  flight  control  and  Monitoring 
tasks,  a  daacrlptlon  of  (canning  phenomena,  and  a  aumary  of  thla  relationship  to  pilot  describing  function* 
and  remnant.  Before  dlacuaalog  some  other  measures  of  workload  In  control  tasks,  ve  shall  summarise  th* 
procedure  for  applying  the  multlaxls  (canning  models  to  a  display  design  profelen  and  relate  key  step*  In 
the  systematic  procedure  to  predictable  display  design  oharactsrlstlcs. 

a  anrsTOWTic  oumuicr  ahd  control  display  resrar  procedure 

The  principal  steps  In  the  procedure  for  predicting  Multlaxls  scanning  behavior  during  preliminary  con¬ 
trol  display  design  are  ordered  numerically  In  Table  X.  The  required  Information  which  serves  aa  a  starting 
point  for  predicting  scanning  behavior  le  developed  In  step  4,  The  general  principles  of  eloeed-loop  eye  tea 
synthesis  and  the  required  analytical  techniques  which  help  to  complete  step*  1  through  4  have  been  described 
In  Reft.  1,2,  3,  4,  10  and  18.  Th*  results  of  step  4  will  Include  a  quantified  block  diagram  for  00*  or 
more  manual  control  technlqua(a)  appropriate  for  the  task  and  closed -loop  frequency  response*  for  all  of  th* 
displayed  variable!  required  for  controlling  and  Monitoring  tha  task  In  response  to  all  coaMand  Inputs, 
disturbance  Inputs,  and  to  Models  for  reienaut.  These  remnant  Models  Make  1".  practical  to  cooalder  th*  cA>- 
served  remnant  as  resulting  fron  equivalent  Injected  noise  sources  at  the  pilot's  perception  and  control 
point*  In  the  mult  Hoop  structure. 

In  step  3  the  effective  dwell  fraction  and  scanning  frequency  for  each  required  point  of  fixation 
( Inst run# nt  or  displayed  symbol)  are  predicted  In  a  way  which  Minimises  the  total  error  variance  vector. 

This  prediction  oust  be  subject,  of  course,  to  the  tiMS-evalleble  constraint  on  the  cumul at  Ire  f  areal  dwell 
fraction,  vhlcb  wlU  be  ultimately  verified  In  etep  10.  Two  different  technique*  exist  for  .performing  etep* 

3  tbroi^h  10:  one,  based  on  th*  physical  Insight  afforded  by  classical  feedback  control  theory,  la  described 
ar4  applied  In  Ref*.  2,  13  and  19)  the  other,  baaed  on  optimal  control  theory,  la  described  and  applied  la 
Ref.  20. 

The  cob* rerice  determinant  In  etep  6  governs  multlloop  stability  In  the  me an-s quart  sens*,  therefore ,  It 
must  be  greater  than  sero.  A  value  for  th*  determinant  which  t*  much  less  than  unity  means  that  incoherent 
error  power  due  to  sampling  remnant  will  be  ouch  greater  than  the  coherent  error  power  due  to  inputs  and 
disturbance*.  If  the  coherence  determinant  approaches  unity  (its  upper  bound),  th*  er.or  power  will  become 
Increasingly  coherent. 

The  coherence  determinant  depends  on  the  display  scantling  statietlae  as  well  as  th*  cloeed-loop  frequency 
response*  to  models  for  sourest  of  remnant.  Therefore,  It  Is  deelrebl*  to  obtain  the  coherence  determinant 
In  analytic  form  first,  so  that  the  average  scanning  statistic*  can  be  estimated  In  conjunction  with  their 
Influence  on  scanning  workload  ( cumulative  dwell  fraction)  In  etep  10  and  nean-equared  error*  In  steps  7  sod 
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TABU!  I.  PROCEDURE  TOR  PREDICTOR)  MJLTTAXI8  8CAJWW0  BEHAVIOR  OR  A  PRELIKDIARY  CORTROL  PISPtAT  UC&TOK 


STEP  HUMBER  AHD  rURPOHE 

PREDICTABLE  RESULTS  FOR  DISPLAY  DESK* 

■:rc»rcn 

1.  Define  the  Control  Problem  and  Taek 

Forcing  Punutlons,  Task  and  Outer-Loop  Variables, 
Controlled  Element  Transfer  Functions, 

Performance  (Error)  Requirements 

2 

2 

8 

2.  Prepare  a  Prospectus  of  Control  Loop* 
by  numerator  Inspection 

3.  Assume  Stability  Margin  Requirement* 

Selected  Loop  Candidate* 

M 

4,  Analyse  Loops  Using  Adaptive  Feedback 
Selection  Hypothesis 

Selected  Automatic  and  Displayed  Feedback*  (Con¬ 
stituent  Signal*,  Reference  Oyeteae,  an!  "Quicken¬ 
ing"  Equal liatlon  for  Display*),  Piloting 
Techniques,  and  Deaorlblng  Function*  in  Each  Loop 
Pilot  Opinion  Ratings 

Closed-Loop  Response* 

? 

? 

7 

3.  Compute  Effective  Di ’play  Scanning 
Behavior  which  Mlnlml.ee  Total 

Error  Vector 

Effective  Dwell  Interval,  Dwell  Fraction,  Scanning 
Frequency  for  Each  Die play 

«,  9 

<1 >,  Compute  Coherence  Determinant  and 

Test  for  Reasonability 

Error  Coherence  (Relative  Reemant) 

8 

7.  Compute  Input-Correlated  Root-Sum- 
Squared  Error  Vector 

Coherent  Syetea  Error 

8 

T.  Compute  Total  Root-Sum-flquered 

Error  Vector  and  Test  Against 
Performance  Requirements 

Total  Bye ten  Error 

’J 

Compute  Foreal  Scanning  Behavior 

Foreal  Dwell  erl  took  Fraction*  for  Eae.  Display 

10 

10,  Test  Cumulative  Scanning  Workload 
for  Saturation  or  Over-Saturation 

Potentially  Saturated  and  Ovoreaturated  Seaming 
Requirements 

11 

U,  Compute  Fixation  Probabilities  and 

Link  Velwee 

Distribution  of  Seaming  Workload  Among  Display* 

IP 

■y,  Arrange  Separate  or  Combined  Displays . 
ft  3.  Establish  Display  floallm  end  Reeolu- 

1  _4&LlllXi - 

Resulting  Pr* 11  erf  nary  Display  Design 

r<>  in 3-2 
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•u\of  iJ*  av.ll  fraction.  vlU  exceed  unity  In  the  .canning  worklood  eoo.tr.l4t. 

'J11*1  or*r.»tur»tlon.  (lore  often  th.  trial  tux  vlU  excaed  (l-*,),  where  K,  1*  a  margin  of  a  earning 
vorhlo*!  for  monitoring,  cosmunlcatloo,  navigation,  a. arch,  ld.ntlflc.tlo5,  fu.1  managemtotTaad  aupervUonr 
v  k.  If?0^r*.dy,U  frMtlon*»  th»  ■'“'of  wnlch  apparently  axca.la  th.  scanning  workload  comtr.lnt,  can 
,  lorr  foT**1  dwoU  fr»°tlon*  lf  parefovoal  perception  cf  th*  appropriately  displayed  signals 

1*  not  lnhllltej.  Reduced  fov*al  dwell  fractious  and  look  traction*  In  .top  9  are  bee  ad  on  th*  relatlr* 
n.wier,  t;~*,  contraet,  and  .eparatlon  of  syrijolli  element*  In  th*  displayed  field  of  view. 


If  the  sun  of  fovea  1  dwell  fraction.  In  itep  50  still  retsain#  overeaturated,  It  Gay  b*  necessary  to  com¬ 
bine  d lap} ay* ,  allocate  o wre  work  to  automatic  loop*,  or,  In  aocae  canes,  assign  task*  to  -DOthsr  crew  mem¬ 
ber. 


T“  itep  11,  the  coaputatlon  of  probabilities  of  fixation  and  tyo  moveaent  link  value*  follow*  th#  aau 
pro  cdure  a*  1*  already  documented  In  Table*  19  and  20,  p.  I5V-155  of  Ref.  10. 

To  step  12,  om  should  be  guided  by  logical  dlaplay-control  esshelatlem*  and  the  Meplay  Arrangement 
Hypothesis  in  Ref.  10,  p.  62. 

Finally,  In  etep  13  one  nay  establish  the  dleplay  ecallng  and  resolution  by  following  th*  rational.  **t 
forth  on  p.  60  of  Ref.  2. 

Thl*  conoludee  a  euwaary  of  the  procedure  for  determining  average  multlcxls  scanning  behavior  on  a  pre- 
lietnary  dleplay  design.  In  view  of  tha  experience  which  we  have  with  lte  application  to  five  different 
aircraft  to  date,  v*  have  high  confidence  of  lte  value  In  dleplay  prdblem-eolvlng  a*  veil  as  preliminary 
design.  Let  u»  now  finally  discus*  seme  models  for  quantifying  pilot  workload  In  control  tasks. 

PILOT  WORKLOAD  MODELS 

Someone  has  observed  that  one  of  the  prerequisites  for  ccnduetlng  research  In  any  discipline  should  b» 
a  set  of  accepted  definitions.  For  example,  In  the  "hardware  world”  such  term*  as  rellsblllty,  failure, 

HUB?,  and  performance  measure  »nt  have  acquired  disciplined  meaning.  Yet  no  such  established  glossary  of 
terms  exist,  for  analysis  of  h.vnan  reliability,  workload,  or  performance.  In  practice  many  ‘measurement*  cf 
system  error  In  human  factors  studies  fall  to  distinguish  sdaptlve  properties  of  human  behavior,  beceus* 

•ven  .  simple  measure  of  workload  such  as  mean-square  control  activity,  which  Is  sensitive  to  adaptive 
behavior,  1*  not  Included.  In  the  spirit  of  offering  a  more  general  definition  of  workload  which  can  b« 
measured  and  predicted,  we  suggest  that  the  ability  (or  capacity)  to  accompli*.)  additional  (expected  or 
unexpected)  teaka  1b  a  suitable  definition  of  workload .  ror  example,  the  pilot  opinion  rating  a'cale~satla- 
fle-  this  definition  up  to  Its  "uncontrollable”  limit  point.  The  fractional  scanning  workload  also  satisfies 
this  definition  a*  long  as  there  exists  a  margin  which  can  be  reliably  traded  for  add ltl coal  tasks.  Further¬ 
more,  «  number  of  «.uxlllary  tasks ,  the  decrements  In  scores  on  which,  from  the  unloaded  itate,  glwa  an  index 
of  the  demand  of  the  primary  task,  will  also  satisfy  this  definition  of  workload.  However ,  on*  particular 
■ensure  has,  at  tho  moment,  very  great  promise  In  Integrating  many  of  the  measures  Into  one  basic  context. 

Thl*  1*  excess  control  capacity,  the  major  connector  with  pilot  rating  and  main  task  effective  time  delay. 
from  this,  we  shall  then  develop  the  further  connection*  with  scanning  workload,  physiological  measures  of 
neuromuscular  tension,  and  th*  effects  of  additional  modalities. 

Pilot  Rating  and  Excess  Control  Capacity 

Several  scales  for  use  In  handling  quality  ratings  exist;  the  most  widely  used,  th*  Cooper  Scale,  con¬ 
tain#  ten  probably  unequal  divisions.  In  spits  of  Its  tin  subdivisions,  It  is  probably  fair  to  say  that  the 
Cooper  8c»J.«  deliberately  emphasises  three  categories  of  Increasing  workload.  Ths  category  boundaries  ere 
between  satisfactory  for  normal  operation  and  acceptable  for  emergency  operation  (a  numerical  J.5).  and 
between  the  emergency  operation  category  end  unacceptable  (a  numerical  6.5).  Its  limit  point  or  10  Implies 
tiiat  the  pilot  had  no  excess  control  capacity— even  for  survival!  The  considerable  pilot  ratine  data  avail¬ 
able  in  Ref.  21  for  the  eatlmatlon  of  handling  qualltiaa  Indicate  that,  where  cloaed-loop  conpensotory 
tracking  Is  the  tank,  the  pilot's  Increment*  In  rating  are  Indeed  baeed  on  the  relative  difficulty  with  which 
ho  obtain*  and  maintain,  the  specified  performance. 

The  notion  that,  among  the  causal  factor*  of  pilot  rating  are  the  pilot’s  attempts  to  nalntoln  performance 
by  vorklr*  to  control  In  spite  of  the  Increasing  difficulty  v*i  further  supported  by  an  experiment  which 
measured  a  parameter  uniquely  related  to  excess  control  capacity  (Rsf.  21 ).  A  secondary  suberltlcal  tracking 
task  vas  used  t.o  "load"  th*  pilot  so  that  hi*  performance  on  the  primary  task  began  to  deteriorate.  A  block 
Jlcgram  of  these  tasks  Is  shewn  In  Fig.  1*.  The  difficulty  of  th*  secondary  task  was  made  proportional  to 
primary  task  performance.  Thu*  when  the  pilot  was  keeping  primary  task  error  performance  leaa  than  a  .  rlter- 

lon  value,  th*  secondary  task  difficulty  was  autonatle- 
ally  Increased  by  Increasing  th*  rste  of  divergence  of 
th*  secondary  Instability.  Conversely,  when  the  pilot 
vas  so  busy  with  the  secondary  Ink  that  primary  error 
—  was  larger  than  the  criterion  value,  the  seconlmry  task 
fl(PHch)  dirfloulty  automatically  decreased.  Hie  final  station¬ 
ary  level  of  secondary  difficulty  va*  determined  by 
the  senaltlvlty  of  the  primary  taek  performance  to 
loadlr*.  Th#  final  "acore"  la  X*.  the  stationary  value 
of  th#  secondary  unstable  pole  (X)  In  rad/sce.  TTie 
score*  obtained  from  this  cross-coupled  sccondsry  tasX 
represent  it*  degree  of  difficulty;  consequently,  they 
also  represent  th#  "degree  of  ease  cf  the  primary  task 
or  th*  excess  control  capacity  available  with  respect 
lo  th#  primary  task. 

Iha  achievement  of  th*  crlllcsl  Umltln;  ecere  In 
th#  cross  -coupled  secondary  task  Indlesics  *  condition 
of  maximum  available  excess  control  cape-ity.  V*  apes* 
of  th#  eeeondery  task  as  e  "erltleel"  task  in  this  limit- 
lt*  cess.  Th*  critical  task  provide*  a  divergent  con¬ 
trolled  element  of  ■  fora  that  tightly  constrain*  the 
allowable  pilot  equalisation  near  th*  region  of  gain 
eroesorer.  Thl*  property  of  the  critical  task  leave. 
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the  pilot'#  effective  liaei  delay,  T„ 

“  ***  •ol*  datermlnant  of  i/iln  rtebil- 
itr.  When  the  divergence  it  gradually 
increased  until  control  li  loot  on  the 
divergence,  thi#  "critical"  divergence 
tie#  constant  i#  a  measure  of  Tt .  (Ref. 84 
*hu#  any  activity  by  the  pilot  vhich 
demands  an  increaae  In  t,  on  the  vhole 
ta#k  can  be  expected  to  preveut  hlm  fram 
achieving  hU  critical  lifting  score 
on  the  c roe i -coupled  secondary  task.  M# 
•hall  return  to  partition  t,  for  the 
vhole  teek  after  llluetratlng  ioat 
resuite  which  ve  here  obtained  with  the 
e roe# -coupled.  sdbcrltical  teek. 

Secondary  acores  obtained  for  a 
variety  of  prlaary  controlled  element*  . 
are  presented  in  Ref.  21 .  Figure  5  above 
hov  the  ecorea  for  the  beet  geln  config¬ 
urations  of  each  controlled  element  com¬ 
pare  vtth  the  Cooper  retire*.  .  The 
agreement  le  extremely  good.  K*«n  the 
•ubcrltlcal  taak  lteelf  in  the  role  of 
the  primary  task,  which  has  been  a 
notable  culprit  In  other  correlations , 
seems  to  be  correlated  linearly  vlth  the 
other  data.  In  Fig.  5  a  acore  Xt  ■  o 
corresponds  to  100  perceftt  of  the 
pilot's 'attention  being  devoted  to  tbe 
primary  task  or  no  excess  eontsol 
capacity,  whereas  a  limiting  score 
(l#  -  !>•?)  means  that  no  attention  le 
required  to  maintain  primary  taak  per¬ 
formance  or  that  :JOO  percent  excess 
control  capacity  is  available. 


lu  our  first  application  of  the  croes-coupled  secondary  aubcrltlcal  task  for  display  evaluation  eeconierv 
T'ntlr  f°r  JMAW  ®>  «i««  integrated  l  "  ^ 

f  ££  "**  ^‘tudlnsa  station-keepl",  with  slmuUUd  helicopter  dy«-lS  ?n  V?o^ 

Uete  inSdltl^  V'  *"  flirry  controU«1  r*»*lrMK5  ^e  s«  throutfrout  the 

r*  .  ’  10  Pllot  •ejects  were  required  to  maintain  the  Assigned  altitude  by  rexulatine  eealnet 

*1  *""*•  “ 

flclll  \  A  for  ‘a  roll  attitude  presented  on  the  artl- 

croes-coupled  to  longitudinal  saparatlon  error  on  the  prlaary  task.  Ibe  pilot  subjects 

and  to  slmladMftttaitBi^L«e1^i  ft1roU  ••  possible  whlls  trying  to  maintain  the  ee Signed  altitude 

ulur  S  ••Paratioii  error  In  following  the  quwl-randca  velocity  fluctuations  of  the 


the  I”  7  *h0V?  ln  fl«-  7  M  '»  functlon  °f  the  prim.  /  display  fomnt.  Rotlcc 

bl^ed  Sith i  dt.ISIS  capacity  to  increase.  If  explicit  rntc  lnfo.~u.tio..  (8  ♦  R)  le  corn- 

end  pilot  ot—ati*onnn  i, .  ^  6f  *"4  th*  tafk  error.  Both  cyc-polnt-of  regard  measurements 

7  th#tvln  “JS  57  "•t*t#;and.r.t*  (8  *  R)  fomat  the  ...bject.  verc  not  monitor¬ 

ing  the  airspeed  Indicator  as  much  as  with  the  ".tate"  (8)  format.  Hence,  vc  nay  Infer  that  this  measured 


Forest  D  Is  t lml Ur  to  I’D  without  the  position  error  symbol 
Ftrere  *.  lategreted  Display  krrswgssmnt  with  of  Fermat  tested  foe  fteeeet  Control  Capacity 
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Norte  1  Fir  $f  f«cond 
Order  of  Lead  Equalization 

figure  8.  i,  «ri«  Effective  Time  Delay  aa  a 
function  of  the  Order  of  Dead  Equalization 
Required  bt  the  Pilot 
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figure  9.  Effective  Tlae  Delay  as  a  Function 
of  Average  Heuroearecular  "'•nslou 


Increase  In  excess  control  capacity  Is  attributable  to 
a  decrease  in  the  nonltorlt*  workload  margin,  because 
the  subject*'  effective  time  delay*  did  net  dsereas* 
in  using  tie  8  H  format.  The  excess  control  capacity 
measurement  In  Fig.  7  exhibits  a  further  increment,  If 
only  a  director  command  (D)  having  the  proper  lead 
equalization  tlah  constant  (Ti  •»  1 .5  nee)  la  dlsplayeu 
with  attitude  lnfpnaatlon.  This  Measured  increase  in 
excees  control  capacity  may  be  attributed  to  a  decrease 
In  the  whole-task  effective  tlais  delay.  Whan  the 
confidence 'Inspiring  task  error  display  la  Integrated 
with  the  flight  director  display  (FD)  having  the  proper 
lead  equalisation  (Tj,  «  1.5  see),  the  Measured  excess 
control  capacity  tends  to  increase  even  More.  This 
application  of  a  secondary  task  has  aa  excellent 
potential  of  becoming  an  objective  Measure  of  workload 
in  suit lax la  display  control  tasks  by  using  a  weighted 
quadratic  sun  of  primary  teak  errors  to  regulars  the 
secondary  Instability. 

Excess  Control  Capacity  and  Whole  Task  Effective  Tlae 
l  Delay 

Thg  effective  time  delay  for  continuous  attention 
on  any  teak  can  be  partitioned  as  follows: 

_  /proportional!  .  /  low-frequency  \ 

Te  "  To\  control  /  'lead  generation/ 

l 

.  /neuromuscular! 

♦  tension  / 

Hies*  are  the  principal  component*  for  .effective  tlae 
'delay  in  a  fixed-base  single-axle  situation.  Each  of 
the  Incremental  components.  At.  and  Are,  can  themselves 
be  considered  as  demanding  an  Incremental  workload 
change.  The  At«  has  In  the  past  been  considered  a 
cause  of  perceptual  workload.  A  plot  of  l/re  versus 
the  order  of  lead  equalization  la  shown  In  Fig.  8.  The 
1 t,  component  which  la  relat/d  principally  to  neuro¬ 
muscular  tension  is  accordljgly  Itself  one  of  the  beet 
workload  associations  with  physiological  measures. 

Figure  9  shows  that  the  average  effective  time  delay 
.decreases  aa  average  ne  rorauscular  tension  Increases. 

Multlaxl/  .■••u-.nlnfc  rzn  also  Induce  significant 
addition*  to  effective  time  delays  needed  to 
accomplish  the  entire  task.  To  the  extend  that  the  net 
time  delay  Increment  due  to  scan  is  a  predominant  acan- 
inlng  offect,  the  scanning  workload  can  Itself  be 
considered  as  an  increment  In  Ta  for  the  vhole  task.  It 
can  then  be  measured.  In  principle,  as  a  change  In  the 
excess  control  capacity  because  the  attainable  score, 
kg,  on  a  side  task  vlll  decrease  a*  rt  Increases.  Tor 
Instance,  our  multiple-loop  results  for  both  latc-al 
and  longitudinal  aircraft  control  with  Integrated  dis¬ 
plays,  l.e.,  altitude  and  pitch  attitude  for  elevator 
and  bank  angle  and  y«v  rate  for  lateral  control,  had 
outer-loop  pilot  describing  functions  which  were 
i  sub  -  tentlally  the  same  ss  those  for  slngle-axl*  equiva¬ 
lent  tasks  (Refu.  2b  and  2j).  However,  with  separation 
of  the  variable*  sbout  the  panel  and  with  the  ecannlng 
then  needed,  the  excess  control  workload  measured  on  a 
cross-coupled  side  task  would  presumably  increase.  The 
difference  between  the  separated  and  Integrated  display 
exceed  control  capacities  would  then  be  tn  Indication  of 
the  i  inning  workload. 

Vh*  I  other  modalities  are  available,  such  as  rotary 
motion  cu*d  from  a  moving  base  simulator  or  actual  air¬ 
craft,  certain  of  the  visual  workload  requirements  een 
be  reduced.  In  the  case  of  rotary  motions  gre»i:<  than 
semicircular  canal  threshold  level*,  the  low-frequency 
lead  generation  requirements  are  reduced  (Ref.  P6).  la 
essence,  the  rotary  motion  cue*  permit  the  pilot  to 
doe*  an  Inner  loop  akin  to  'hat  of  a  rat*  gyre,  lb* 
net  effect  le  to  reduce  the  rffective  whole-task  time 
delay  by  about  O.iJ  eec  (which  also  happsti*  to  be  the 
|  At*  increment  required  to  develop  a  flret-order  low- 
50  frequency  lead).  Thu*  the  total  visual  workload  will 
have  been  reduced  by  the  addition  of  motion.  On*  could 
say  that  the  total  workload  hem  not  been  changed  because 
whet  had  previously  been  don*  with  the  visual  channel 
was  now  ncco^llehed  by  the  visual  plus  motion  channel* 
acttrtg  together.  However,  the  motion  loops  are 
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h«  •  qualitatively  .l«l“.r.f?ect;  *  P  **•  P#iaf0rcln«  “••  of  ™ral  and  otter  -odalltu.^,0 

ccncwonrj  rkhamcb 

SSISHSSSHS-- 

-  a-VJrcsMt  sasra.-are. ir-* in  tM-  ^  -^•zzss.'ss 

To  tjw  aeronautical  dluplay  designer  unfamiliar  vith  or  unpracticed  in  ueing  the  aathesatlcs  of  feedback 

d£Slt^2«  I**.'*'  °f  I"**-"***0*  ■<*•*•  of  Pilot  dynamic  .till  ...»  to  be.cWcol  Z 
difficult  art  to  learn.  Hoover,  thnss  difficulties'1  are  gradually  disappearing  aa  more  rapid  comita- 
t.onal  aide  appear  to  reduce  the  artl.try  in  application.  The  bigge.t  challenge  for  the  practlonerTrsLin.-- 
-ore  uaere  by  simplifying  the  application  of  the  theory  vithout  compromising  it.  acope  or  validity 
and  the  physical  lnaight  for  problem-solving  provided  thereby.  1 
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APPENDIX  B 


SUMMARY  OF  PREDICTED  PILOT.  LOOP  CLOSURES 
FOR  THE  MULTIAXIS  EXPERIMENT  WITH 
CH-53  AIRFRAME  DYNAMICS 
Contributions  by  Richard  E.  Blodgett 

A.  LONGITUDINAL  SEPARATION  CONTROL  CLOSURE  ANALYSIS 

A  general  block  diagram  for  the  loops  being  closed  through  the 
human  pilot  is  shovn  in  Fig.  B-1 .  The  block  indicated  "augmented 
CH-53  airframe  dynamics"  is  obtained  as  shown  in  Fig.  B-2  by  adding 
the  effects  of  rotor  and  actuator  lags,  and  AFCS  feedback  to  the  bare 
airframe  dynamics.  The  resulting  numerators  and  denominator  for  the 
various  closed-loop  transfer  functions  have  been  obtained  from  Table  IX 
of  Ref.  2  and  are  listed  here  in  Table  B*I. 

The  order  in  which  the  loops  in  Fig.  B-1  will  be  closed  is:  first, 

0  -*  5^,  and  then,  u  -*  9C  and  x  ■*  uc  simultaneously.  The  augmented 
airframe  transfer  function  *  0/B^  is 

e  4.4i  (o.o)(o.668)(-io.3) _  r,\ 

&b  ~  ( o .  0284 )  ( 0 . 71 7}  ( i .  48 )  [ 0 . 509 ;  2 .275  j 

The  first  loop  0  -*  5b  is  a  >.ow  gain  manual  loop  with  effective  time 
delay  T0  =  .33  sec.  Although  this  manual  closure  may  seem  redundant 
and  deleterious  because  of  the  pitch  AFCS,  the  purpose  in  making  this 
closure  is  to  investigate  the  effects  of  transfer  of  training  in  adopting 
a  0  -♦  &b  loop  by  helicopter  pilots  who  may  not  be  accustomed  to  the 
augmented  airframe  "short  period"  dynamic  properties  provided  by  the 
pitch  AFCS.  In  terms  of  the  block  diagram  in  Fig.  B-1,  Og  •  e“*^°  and 
Fq  a  Kg.  The  objective  is  to  choose  Kg  ouch  as  to  reduce  the  damping 
ratio  of  the  "short  period"  complex  pair  [O.5O9;  2. 275]  to  not  less  than 
about  0.3*  For  the  purpose  of  analysis,  the  exponential  will  be  repre¬ 
sented  by  a  first  order  Podc?  approximation. 


•Abbreviated  notation  is  used  throughout  this  Appendix  for 
polynomial  factors  of  each  transfer  function  in  root  locus  ferm. 

Numbers  unclosed  in  parentheses  are  first  order  factors,  vis. ,  (s  ♦  a)  *  (a) 
Quadratic  factors  are  enclos-  d  in  brackets,  via. , 
f.o-  +  2£«<J  ♦  o£l  «  fC  j  cuJ*  Prefixed  numbers  not  enclosed  are  the 
high  fiequoncy  gains  of  the  transfer  functions. 


Figure  B-1  .  Human  Pilot  Loop  Closure  Configuration 


TABLE  B  -I 


AUGMENTED  LONGITUDINAL  TRANSFER  FUNCTIONS  RESULTING 
FROM  Ar*CS  IMPLEMENTATION  IN  FIG.  B-2  (Ref.  2) 

Denominator 

A  =  (0.0284) (0.71 7) (6.48) ( 10.0) [O.5O9,  2.275] 

Selected  Control  Input  Numerators 

g 

N6p  '  =  4.4i (0.00056) (0.668) (10.0) (-10. 31 4) 

N&b  “  -1 6. 9(0.693) (lO.O) (-19. 112) [0.034;  2.093  ft /sec  (see 

rad  footnote) 

NBC  =  " 31 1 0.0(0.0267) (6.77) [0.449 ;  2.279]  ft/sec 

rad 

N6C  =  -  32. 1(0. 477)(l5.2)[-0. 663;  2.312]  ft/sec 

rad 

=  -0.1Nqc  for  a  1  : 1 0  glideslope 

Selected  Gust  Input  Numerators 

Q  q 

Nu  *  -0. 00324(0. 0)(o.643)( 10. 0)2  rad 

u  Wpw 

ft/s;c 

Nug  e  0.0227(0.681 ) (9 «4)( 1 0.0) [O.O351 ;  2 . 1 68] 


#The  numerator  Nj^  is  approximated  as 

N&b  4  -16.9  j-  19.1 12(0. 693)(l 0.0) (0.0J4;  2.09 )|  for  use  in  the 
loop  closure  calculations. 


(2) 


■v 


8  — 


8  + 


The  effective  time  delay  t q  includes  the  effect  of  higher  frequency 
neuromuscular  lags  and  visual  delays  in  the  human  pilot.  A  detailed 
explanation  of  the  components  of  this  effective  delay  is  given  in 
Ref.  1 .  Since  the  longitudinal  gust  forcing  function  bandwidth  is  so 
low  (0.2  rad/sec),  we  expect  virtually  no  reduction  in  time  delay  from 
prefiltering  by  increased  neuromuscular  tension. 

Combining  equations  (2)  and  (l)  gives  the  approximate  open-loop 
expression 


0f 

Te 


-  ( 0 •  °M  t6 •  M °iw) 

~  K^(o.02fi4)(0.7l7)(6.0)(6.4f 


.48)|6.5Cri;  2.275’ 


Closing  this  loop  with  a  gain  Kg  »  -.2  gives  the  closed-loop  denominator 


A'  =  (0. 0255K0. 700)  |o. 316;  2.29110.949;  7. 04l|/(6.0)  (3) 

where  the  damping  ratio  of  the  short  period  oscillation  has  been  reduced 
to  not  less  than  about  0«3« 

The  next  loops  to  be  closed  are  for  perturbed  position  and  velocity. 
The  column  for  the  "state"  display  format  in  Table  B-II  indicates  the 
predicted  appropriate  block  values  for  the  diagram  in  Fig.  B-l .  The 
open-loop  transfer  function  for  this  loop  closure  is 


x 

*e 


323.0  Kx  e 


.(°.J3  + 


(o»o) (0.0225) (0.700) (0.316; 


(i/tlx)(°-695)(6.o)[o.03U;  2.09] 
2.29|  |o.9^9;  7*o4i| 

(*> 


The  additional  increment  of  time  delay  will  be  token  as  0.2 

sec.  (Ref.  5).  This  results  from  the  pilot  having  to  generate  first 
order  lead  as  indicated  in  the  transfer  function  0„  in  Table  B-II.  The 
required  lead  time  constant  Tj^  typically  ranges  from  two  to  five  sec  with 
five  sec  being  about  the  measured  human  upper  limit.  The  location  of 
the  zero  at  -l/T^  is  very  critical  with  respect  to  closed-loop  system 
stability  margin.  Larger  values  of  Tj^  lead  to  more  heavily  damped 
dominant  closed-loop  roots.  The  cases  to  be  considered  are  listed 


B-? 


TR  1B3-2 


TABU!  B-n 


Predicted  forma  for  the  human  pilot  describing  functions  in  Fig.  B-1  with 
changes  in  Display  Format. 


DISPLAY  FORMAT 

_ 

bOT  h 

DIAGRAM 

STATE 

STATE -AND -RATE 

DIRECTOR 

GO 

CD 

1 

£ 

CD 

e"T08 

e“T0s 

*0 

*0 

Ke 

Gu 

1 

1 

i 

Fu 

0 

*u* 

*u* 

Gxe 

KX<V  +  ')e'ATU:AI>S 

Kx  * 

*x  * 

*The  last  two  entries  in  the 
are  equivalent  to  0Xe  ■  MV  + 
changed  to  zero  and  command  input 


State  and  Hate 
l),  where 
xc  is  changed 


and  Director  columns 

■  ^ 

to  Xft  in  Fig.  ®“1  • 
(t^s  +  I ) 


TR  1«3-2 
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below  with  their  corresponding  open-loop  transfer  functions, 

Tr  -5.0  sec  (ATrx,An  -  0.2  sec) 
x 


LEAD 


-  Kv,  -1615.0  (-3. 77) (0.2) (0.693)  (6.0) TO. 03^.*  2.093 
x(o. 09(0. 0225J(0.700)(3. 77)[0.316;  2. 29 Jt 0.9^9;  7.  oil 


=  3-33  sec  (At^^  «  0.2  sec) 


.*  •  K,  -1075.5?  (-3.77)(o.3)(o.693)(6-o)Cp-o»;  g-o?] 
xe  ^o.o)(o. 0225) ( 0 . 700) ( 3 . 77) [ 0 . 31 6 ;  2 . 29 J [0.949 >  T.oUi  j 

(6) 

The  resulting  root  loci  are  shown  in  Figs.  B-3a  and  B-3b.  From  the 
corresponding  open-loop  frequency  response  in  Tables  B-IIIa  and  B-HIb, 
values  of  can  be  chosen  to  yield  the  gain  crossover  frequency  for 
maximum  phase  margin.  The  results  are  given  in  Table  B-IV.  They  repre¬ 
sent  the  predicted  loop  closure  characteristics  for  the  pilot  with  the 
state  display  format. 

The  final  case  to  be  considered  is  for  the  pilot  to  be  given  a 
display  of  rate  as  well  as  position.  This  is  indicated  by  either  the 
state-and-rate  column  or  the  director  column  in  Table  B-II.  It  may  be 
noted  that  ^TTiT^Ari  "  0  for  the  reasons  that  the  pilot  does  not  have  to 
generate  his  own  lead  information  and  no  incremental  scanning  delay  it 
predicted  on  the  integrated  display.  The  open-loop  transfer  functions 


5.0  aec  -  0) 

V  „  a-<g] 

A( 0.0) (O.O225) ( O.7OO;  [0.316;  2.29 j[0. 949;  7.041 


2.5  sec  (At 


LEAD  ' 

-807.5  (-6.0)(0.4)(0.< 


Ji  .  kx, —J22L1A  “?„•  °.K  0,«  M  °  0  ■  °3UI  r  2  ♦  °?  J ..  - 

Xc  K( 0. 0) ( 0, 0225) (0. 700) [0.316;  2.29JC0.949;  7.041 j 

(6) 

Table  B-IV  again  given  the  values  of  Kx  which  yield  the  gain  crossover 
frequency  for  maximum  phase  margin  from  the  corresponding  open-loop 
frequency  responses  in  Tables  B-IIIc  and  B-IIIJ.  These  results  In 


tb  183-2 


a)  TLx  ■  50  sec 

A  ri_EAD  =  0-2  sec  (pilot- generated  lead) 

,o  \o  -13.0 

&  ?vV 

(**.0033 


Closed- loop 
"short  period" 
branches 
for  two  values 
of  Kg  (pilot) 

Closed -loop 
"phugoid"  branch  is  sensitive 
to  pilot's  gain  Kx 

_ i _ 

-2.0 


b)  TLx  »  333  sec 

Ar LEAD  3  0.2  sec  (pi lot- generated  lead) 


c)  TLx.  5.0  sec 

Atleao  *  0  sec  (director-generated.lead) 


Closed-loop 
"  phugoid"  bronch 

is  very  sensitive 
to  pilotW  gain  Kx- _ 00050 


“20 


Kx* 0.0033  < 

(rad/ftf 

,  0.00  ir_ 

- J- - o-x  * 

-10  I  0 

TU 


d)  TLk  8  2.5  sec 

At  lead®  0  sec  (director- generated  lead) 


TABLE  B-XXI  (a) 


Open-loop  frequency  response  |  x/x^  for  =  5.0,  ^tleaD  “  S8C 


0) 

rad/sec 

1  *Ae| 

dB 

Zx/xe 

deg 

.100 

71 .03 

-145.4 

.200 

9 

61.1b 

-13b.3 

.300 

56.24 

-134.2 

Probable 

.400 

a 

§8 

53.0* 

-133.2 

Crossover 

♦  500 

ijsi 

TJ-? 

»>_S 

u  ■- 

50 . 7  7 

-134.2 

Range 

.6  00 

.700 

3  ? 
o  • 

4d.02 

4  7.37 

-136.4 

-137.4 

.  500 

46.00 

-  1  4  3  *  1 

.  300 

44.  76 

-14  7.2 

1  .000 

43.60 

-1 5l .6 

l  .  100 

42. 4b 

-156.4 

1  .200 

41*37 

•161.5 

1  . 300 

40.24 

-1  67.0 

1  .400 

JV  .04 

-1 72.  7 

1 .500 

37.  71 

-  1  7  5  .  ( 

1  .  AUO 

3  6> .  10 

-  1  t'  4  •  C 

1  . 700 

34.  J4 

-  1  VO.rt 

tr  185-2  B*^ 


tabu:  b-iii  (*) 


Open-loop  frequency  response  Jx/xel  for  -  3*33,  -  0.2 aec 


<£> 

rad/sec 

l*/*e| 

Zx/Xg 

dB 

deg 

.  1  JO 

70. 50 

-153.6 

•M0  £ 

1  M-7S 

- 1  49 . 7 

i  J 

:/  54.13 

-145. 5 

/  e  o 

/,/.  ,  /  0  u 

— > 

Probable 

•'100  ijs  * 

/"0-2 1 

50.53 

-143. b 

••WO  Hi 

hi 

47 .03 

-143.3 

Crossover 

»  6;)0  /  a; 

4  5.90 

-1 44. b 

(*-o| 

— 

Range 

.700 

44.23 

-146* 7 

•  hOO 

42 . 7c 

-149.6 

.  900 

41 .4- 

-153.  1 

1  .  0  )0 

40 . 2  7 

-1  57.0 

1.100 

;w.  i  a 

-161.4 

1  .»*  JO 

3  7.9  9 

-166,] 

1 .300 

36 ,  e  3 

-1  71  .2 

1  .400 

35.62 

- 1  76, 6 

1  •  S  JO 

3  4 . 2  r* 

-  1  52  »  4 

1  .600 

32. 74 

-  1  C  K  .  3 

1  .  70  J 

30  . «  C 

-  1  *  4*  1 
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TABLE  B-HI  (c) 


Open-loop  frequency  response  |x/xel  for  Tj^  =  At LEAD 


U) 

U/Xgl 

Zx/xe 

rad/sec 

dB 

deg 

.100 

71  .03 

-  1 44.  J 

.woo 

6 1 . 1  e 

-136.1 

.  300 

0 

s^.WA 

-  1 30  .  6 

»  000 

a 
c  0 
0  * 

*’>3»0 ) 

-  1  y.t'i .  7 

«  500 

J :  •> 

a 

30 . 7  7 

-  1  'fit  »  f 

.  A  00 

-§1 
0  * 

at; 

Ac . 

-  1  is  ' .  7 

.  700 

21 

A  7. 3  7 

-131.7 

•  MOO 

46.00 

-1 3A. J 

.000 

A  A  .  7  6 

-137.  A 

1  .000 

43*60 

-  1 eQ  •  0 

1  . 100 

42«  Ab 

-l  AA.  7 

l  .200 

A 1  *37 

- 1  Ac  *  y 

1 .300 

AO.  2A 

•  1 33. A 

1.400 

39. OA 

- 1 .  2 

1.500 

37.  71 

-163.3 
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Summary  of  parameter  choices  for  maximum  phase  margin  lr  the  outer 
longitudinal  separation  loop  closure. 
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Table  B-IV  can  be  used  to  predict  the  best  displayed  scaling  ratio  between 
state -and-rate  signal  content  and  to  establish  the  best  feedback  gaino 
for  the  director  command  'law",  so  as  to  relieve  the  pilot  of  generating 
the  necessary  lead  equalization  solely  from  a  state  display  of  longitu¬ 
dinal  separation  error  Xg. 

Since  the  lead  equalization  time  constant  equals  Ku/Kx>  the 
proper  displayed  scaling  ratio  between  rate  xe  (=  u,  if  x<.  <=  0)  and 
state  xe  is  given  expiicity  by  In  other  words,  the  gain  of  the 

u-dioplay  should  be  Tlx  times  the  gain  of  the  ::e  display.  Then  by 
controlling  longitudinal  cyclic  pitch  so  as  to  match  the  u  and  x^ 
symbols  in  the  state -and-rate  format  or  to  null  the  director  command  in 
the  director  format,  the  pilot  will  be  assured  that  the  proper  lead 
equalization  is  being  provided  to  null  Xg.  The  results  in  Table  B-IV 
3how  that  2.5  <  Tp^  <  5  sec,  depending  on  the  adopted  phase  margin 
(or  damping  ratio  of  the  closed-loop  phugoid  shown  in  Fig.  B-3).  Com¬ 
parison  of  the  corresponding  root  loci  in  Fig.  B-3c  and  B-3d  shows  that 
a  value  of  Tp^  =  3*3  sec  should  provide  adequate  phase  margin  in  excess 
of  50  deg.  (Table  B-IV)  and  a  closed-loop  phugoid  damping  ratio  in 
excess  of  0.4  which  is  less  sensitive  to  the  pilot's  gain  variation 
than  if  a  larger  value  of  were  selected.  A  separation  error  loop 
gain  on  the  order  of  Kx=0.0032  rad/ ft  will  provide  a  crossover  frequency 
In  excess  of  0.4  rod/sec  to  regulate  against  the  longitudinal  gust 
forcing  function  bandwidth  of  about  0.2  rod/sec  at  60  knots  true  air 
speed . 

The  root  loci  in  Fig.  B-3  also  show  the  effects  of  the  pilot's 
adopting  a  low  gain  (Kq  -  -0.2)  pitch  attitude  closure  through  his 
longitudinal  cyclic  pitch  control  stick  in  addition  to  the  loop  closure 
for  the  pitch  AFC3  described  in  Fig.  B-2.  The  root  loci  show  that  the 
pilot  will  reduce  the  damping  ratio  of  the  "short  period"  characteristic 
oscillation  to  between  0.3  and  0.4  with  the  recommended  AFCf*  in  Ref.  10 
and  depicted  in  Fig.  B-2,  viz. , 

Rotor  and 

Actuator  Lag  AFC9 

Bt  (0)  -  bp(a)  -  O.lTa  +~2)~9(8)|  (9) 

8  +  10 

where  lo  the  longitudinal  cyclic  (rotor  blade)  pitch  angle.  Further 
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increase  in  Kg  by  the  pilot  will  reduce  the  short  period  damping  ratio 
unfavorably.  However,  the  second  order  lead  equalization  provided  by 
the  complex  zeros,  0^],  in  the  speed  response  will  tend  to  reduce 

the  sensitivity  of  the  decreasing  short  period  damping  ratio  to  further 
increase  in  the  pilot's  pitch  attitude  gain,  Kg. 

The  flight  director  command  equation  can  be  implemented  with  the 
aid  of  Table  B-II  by  forming  a  linear  combination  of  all  of  the  human 
pilot's  feedback  and  feedforward  transfer  functions  which  contribute  to 
the  signal  labelled  0e  in  Fig.  B-1 ,  viz. , 

0e  c  -  KgS  -  K^xx  ~  KxX,  if  xc  =  0 

=  “  K00  -  K^T^s  +  l)x  (10) 

where  -0.2  <  Kg  <  0  for  command  consistency  with  mid-frequency  pitch 

attitude  motion,  Kv.  =  0.0032  rad  for  adequate  gust  upset  suppression 

ft 

bandwidth,  and  Tp^  =3*3  sec  for  adequate  closed-loop  phugoid  damping 
ratio  (0.4  <  £  <  0.5).  The  relative  gains  of  the  various  contributions 
to  the  flight  director  are  now  established.  The  actual  flight  director 
command  signal  on  the  display  is  given  by 


5, 


(11) 


K^ILOt®STICK  ^DISPLAY 
where  the  values  for  gains  ^SgTICK  raufl^ 

the  experiment  to  the  personal  satlrfaction  of  each  subject  following 
the  procedure  outlined  in  Ref.  5* 

This  completes  the  analysis  of  predicted  pilot  loop  closures  for  a 
longitudinal  separation  control  task  in  landing  approach  with  CH-53 
dynamics.  The  following  section  in  this  Appendix  presents  a  simplified 
approximate  analysis  of  a  decoupled  altitude  deviation  control  task. 


B.  ALTITOXJE  CONTROL  CLOSUFF  ANALYSIS 

The  simplified  transfer  function  to  bo  used  for  simulating  the  air¬ 
frame  altitude  deviation  (h)  response  to  collective  lift  control  (6C) 
can  ho  approximated  from  Table  B-I  as 


JL 

°c 


7o.o)(o. 717/(10.0) 


-£fc 

rad 


(12) 


The  pure  integration  in  the  altitude  deviation  response  tc  collective 
lift  control  will  be  approximated  as  a  slow  divergence,  (-n) ,  where 
0.1  rad/sec,  so  that  the  only  forcing  function  necessary  for  this 
took  will  be  the  pilot's  remnant.  Therefore,  the  simulated  controlled 
element  transfer  function  for  the  altitude  regulation  task  will  be 

JL  « 

6c 

Block  diagrams  of  the  altitude  deviation  feedback  to  the  display 
and  of  the  pilot's  loop  closure  through  the  collective  control  to  regulate 
altitude  deviation  are  presented  in  Figs.  IV-2  and  IV-4  in  the  text, 
Section  IV.  Although  it  will  be  displayed,  the  altitude  rate  (or 
instantaneous  vertical  speed)  feedback  will  probably  not  be  needed  by 
the  pilot  for  equalization,  as  the  closure  analysis  will  show  subse¬ 
quently.  Instead  the  altitude  rate  (or  instantaneous  vertical  speed) 
display  will  probably  be  required  only  for  monitoring  rateB  of  change 
of  the  state  of  vertical  error. 

The  bandwidth  of  the  vertical  gust  forcing  function  which  would 
normally  upset  altitude  deviation  at  a  speed  of  60  knots  true  air 
speed  is  about  l/j  rad/sec.  This  is  only  about  one-half  the  bandwidth 
of  the  helicopter's  heaving  subsidence  at  60  knots  and  suggests  that 
adequate  altitude  regulation  can  be  achieved  with  a  pure  gain  closure 
or  perhaps  a  closure  with  only  high  frequency  lead  to  reduce  the  pilot's 
time  delay.  In  the  actual  experiment,  of  course,  the  much  broader  band¬ 
width  of  the  pilot's  remnant  will  serve  as  a  forcing  function.  In  order 
to  try  to  predict  the  gain  crossover  frequency  and  equalization  which 
the  pilot  may  adopt  in  performing  the  simulated  altitude  regulation 
taak,  we  have  examined  the  sensitivity  of  the  closure  to  several  values 
of  gain  and  high  frequency  lead  equalization. 

The  pilot's  effective  time  delay  (te)  for  this  closure  can  be 
estimated  with  sufficient  precision  by  partitioning  the  delay  in  two 
parts:  (l)  the  pure  latency,  T  i  0.1  bcc,  and  {?,)  the  effective  low 
frequency  lag  of  the  neuromuscular  system  coupled  with  a  free  collective 
stick,  Tfj  «  0.2  sec. 

Hoot  loci  for  two  illustrative  closures  are  shown  in  Fig.  A-4. 
Corresponding  open-loop  frequency  responses  including  the  probable  gain 
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crossover  frequency  range  are  listed  in  Table  B-V.  The  probable  cross¬ 
over  frequency  ranges  are  bounded  from  below  by  the  gains  for  maximum 
phase  margin  listed  in  Table  B-VI. 

The  effect  of  high  frequency  lead  equalization  (0.1  <  T.  <  0.355  sec) 

—  L  — 

is  presented  in  Fig.  B-4a  and  B-4b  and  Tables  B-Va  and  B-Vb.  The  estimated 
crossover  frequency  range  1b  from  0.3  to  0.4  rad/sec,  if  the  pilot  should 
adopt  lead  equalization  such  that  T^  -  0.333  sec.  Otherwise,  in  all  cases 
examined,  the  estimated  crossover  frequency  range  is  from  0.2  to  0.3  rad/sec. 
Closures  without  lead  and  with  0.1  sec  additional  effective  time  delay, 
presumed  due  to  an  additional  scanning  delay  or  neuromuscular  lag,  exhibit 
slightly  smaller  stability  margins  (and  damping  ratio)  as  shown  in 
Table  B-VI. 

Since  we  do  not  expect  the  pilot  to  adopt  lead  equalization  below 
2  rod/sec  and  requiring  significant  perceptual  motor  workload  in  the 
simulated  altitude  regulation  task,  the  displayed  signal  gain  for  the 
instantaneous  vertical  speed  display  need  be  only  one-half  that  for  the 
altitude  deviation  display. 

C.  EXCESS  CONTROL  CAPACITY  (ATTENTI0NAL  WORKLOAD)  ANALYSIS 

The  results  obtained  in  Ref.  5  with  a  secondary  cross -coupled 
subcritical  roll  tracking  task  as  a  function  of  various  single-axis 
controlled  elements  will  form  a  basis  for  predicting  excess  control 
capacity  for  the  present  pilot  experiment.  The  score  obtained  from  the 
cross -coupled  secondary  task  is  the  steady-state  value  of  its  unstable 
pole,  which  represents  its  rate  of  divergence  or  degree  of  difficulty; 
consequently,  the  same  score  also  represents  the  "degree  of  ease"  of 
the  primary  task.  The  abscissa  in  Fig.  A-5  illustrates  the  secondary 
task  scores  obtained  irom  Ref.  5  no  e  function  of  several  forma  of 
controlled  element  denoted  by  the  symbols  along  the  ordinate.  The 
secondary  task  scores  also  correlated  well  with  the  subjective  pilot 
opinion  rating  of  the  primary  tasks. 

Two  interpretations  can  be  given  to  the  secondary  task  score  by 
normalizing  the  score  with  respect  to  the  critical  or  limiting  score 
which  the  subject  can  achieve  if  the  secondary  task  Is  the  only  task. 

These  two  interpretationo  of  the  normalized  score  are  shown  on  scaleB 
at  the  top  of  Fig.  Ik-'),  The  normalized  .,core  itself  can  be  Interpreted 
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TABLE  B-V  (b) 


Open-loop  frequency  response  jh/8c|  for  a  0.1,  ■  (0.3  -  T^)  sec 

Te  =  t  +  —  T^,  where  the  latency,  t  =  0.1  sec  and  the  effective  low 

frequency  neuromuscular  lag,  ■  2.0  sec.  The  lead  equalization  is 
included  in  the  effective  time  delay. 
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TABLE  B-VX 


Summary  of  parameter  choices  for  maximum  phase  margin 
in  the  altitude  regulation  closure 
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aa  the  excess  control  capacity  which  the  pilot  haa  available  for  perform¬ 
ing  other  tasks  while  maintaining  performance  on  the  primary  task(s). 

If  the  normalized  score  is  subtracted  from  unity,  the  resulting  scale 
can  be  interpreted  as  a  measure  of  the  pilot's  fractional  attentional 
workload  required  for  performing  the  primary  task. 

At  the  present  state  of  our  understanding,  the  ’'best"  partition 
of  controlled  element  and  display  gains  ("control  gains",  for  short) 
required  to  produce  the  results  in  Fig.  A-5  must  still  be  empirically 
determined.  Over  a  wide  range  of  control  gains,  however,  research  in 
handling  qualities  has  shown  that  the  average  absolute  tracking  error 
is  nearly  constant,  whereas  the  pilot's  gain  varies  inversely  with 
the  control  gain.  The  subjective  rating  of  the  task  and  the  secondary 
task  score  show  a  distinct  optimum,  which  is  not  revealed  by  either 
the  error  score  or  the  pilot's  gain.  (Refs.  4  and  5.) 

The  principal  cause  of  the  trends  shown  in  Fig.  A-5  is  due  to  the 
Increasing  attentional  workload  which  accompanies  the  generation  of 
low  frequency  lead  equalization  by  the  pilot  as  the  controlled  element 
form  progresses  from  K/s  to  K/s2.  However,  the  extremely  high  atten¬ 
tional  workload  (low  excess  control  capacity)  associated  with  the 
unstable  primary  controlled  element  K/(s  -  2)  in  Fig.  A-5  is  probably 
associated  with  a  different  cause.  This  cause  is  thought  to  be  the 
increasing  neuromuscular  tension  which  accompanies  the  consistently 
reduced  effective  pilot's  time  delay  measured  with  this  type  of  con¬ 
trolled  element  for  which  low  frequency  lead  equalization  is  not  required. 

Since  the  present  experiment  involves  two  simultaneous  piloting 
tasks  for  which  we  wish  to  predict  the  excess  control  capacity,  we 
shall  adopt  a  technique  from  Ref.  6  for  predicting  pilot  ratings  for 
multi-axis  control  tasks  using  single-axis  rating  data.  This  technique 
lo  based  on  an  empirical  relationship  between  measured  excess  control 
capacity  and  the  pilot's  generated  lead  time  constant,  Tjf.  The  single- 
axis  prediction  technique  is  illustrated  graphically  in  Fig.  B-5  using 
results  extrapolated  from  Ref.  5*  •  The  upper  portion  of  Fig.  B-5  is 
entered  at  the  ordinate  corresponding  to  the  estimated  pilot's  lead 
time  constant  predicted  from  display -pi lot -vehicle  closed-loop  analysis. 
Then  by  following  the  indicated  arrows,  one  can  estimate  either  the 
attentional  workload  fraction  or  the  excess  control  capacity  for  the 
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R-PP 


single-axis  task. 


Reference  6  predicted  raultiaxis  pilot  ratings  of  hailing  quanities 
using  a  method  proposed  by  tt TI  in  Ref.  7»  The  predictions  were  then  com¬ 
pared  in  Ref.  6  with  two-ax? s  pilot  ratings  obtained  experimentally  and 
the  average  correlation  tas  shown  to  be  excellent.  When  the  same  method 
(Ref,,  7)  is  extended  for  predicting  excess  control  capacity  with  the  aid 
of  the  lower  portion  of  Fig.  B-5  for  each  axis,  raultiaxis  excess  control 
capacity,  (xscc)m,  is  obtained  from  the  equation 

(  N 

(xoco)»  '  f  |  -IMSE  +£2 


where 


Xs/Xc  =  f(Tk)  is  defined  by  Fig.  B-5. 


^BASE 


^  ^(XaMAY/Xc) 


8MAX'  nc' 

V0MAX/Ac  “  raQXljnura  excess  control  capacity  among  the  single 
axes  comprising  the  multi-axis  situation. 


We  shall  illustrate  the  use  of  Eq,  14  by  predicting  a  multi  axis  excess 
control  capacity  for  the  experiment.  The  estimated  pilot's  lead  time 
constant  for  the  longitudinal  control  axis  is  -  3*5  sec  from  topic  A 
in  this  Appendix.  (The  effective  controlled  element  is  K/s2.)  By 
entering  the  ordinate  of  the  upper  portion  of  Fig.  B-5  at  T^  *  3.5  sec, 
we  can  use  the  optimistic  extrapolation  of  Ref.  5  denoted  by  the  broken 
line  labelled  "0",  to  estimate  an  upper  bound  of  O.35  on  the  excess 
control  capacity  for  the  longitudinal  axis.  We  can  also  use  the  pessi¬ 
mistic  extrapolation  of  Ref.  5  denoted  by  the  broken  line  labelled  ”P”, 
to  estimate  a  lower  bound  of  0.19  on  the  longitudinal  excess  control 
capacity. 

The  estimated  pilot's  lead  time  constant  for  the  vertical  control 
axis  in  <  0.5  aec  from  topic  B  in  this  Appendix.  A  glance  at  Fig.  B-5 
shown  that,  if  <  0.5  nec,  the  predicted  single-axis  control  capacity 
would  be  X0/xc  >  O.5O  for  the  vertical  axis  from  the  data  of 


Ref.  5. ■  However,  the  effective  controlled  element  for  the  vertical 
axis  is  K/s(s  +  0,7),  which  is  approximately  like  the  controlled 
element  K/s(s  +  l),  for  which  a  measurement  of  excess  control  capacity 
is  plotted  in  Pig.  A-5  as  Xg/Xc  ■=  0.46.  This  measurement  corresponds 
to  an  inferred  pilot  lead  time  constant,  Tg  »  1  sec. 

Since  either  task  could  be  performed  with  an  effective  director 
dioplay-and-controlled  element  K/s,  we  shall  adopt  the  excess  control 
capacity  of  O.75,  corresponding  to  K/s  in  Pig.  A-5,  as  ^smax/^c  for 
use  in  Eq.  l4„  Reference  to  Fig.  B-5  will  show  that  n  °*75 

corresponds  to  0  0  in  Eq.  14,  Hence  the  indicated  summation  in 

Eq.  14  becomes  simply  a  sum  of  two  single-axis  values  for  Tg,  corre¬ 
sponding  to  the  longitudinal  and  vertical  axes  in  the  experiment.  The 
estimated  range  for  this  sum  is 


E 

i«2 


tLj.  >  >3  sec 


(15) 


The  corresponding  optimistic  range  for  the  predicted  multiaxis  excess 
control  capacity  in  this  experiment  is 

0.08  <  (xacc)ra  <  O.55  ( 1 6) 1 

and  the  corresponding  pessimistic  range  i3 

0.08  <  ( xscc )ra  <  0.19  '  ;  (17) 

There  is  a  much  simpler  empirical  way  to  make  these  multiaxis 
estimates  from  the  single-axis  estimates  of  excess  control  capacity, 
viz. ,  to  rmiltiply  the  single-axis  estimates,  if  they  are  different, 
and  to  use  the  single-axis  maximum  estimate  itself  when  the  estimates 
for  each  axis  are  equal  to  the  maximum  estimate  for  display-and -con¬ 
trolled  element  K/o.  To  illustrate  how  closely  this  rule  approximates 
the  pessimistic  range  in  Eq,  17,  we  shall  form  the  indicated  products 
In  PJq.  18. 

( 0 . U6) ( O.19)  <  ( xscc ) m  <  (0.';,8)(P.35) 

0.09  <  (xscc)m  <  0.2  (18) 

Although  Ref.  6  presents  none  of  the  single-axis  experimental  data 
by  which  the  accuracy  of  this  "product  rule"  could  be  tested,  it  also 
works  quite  well  on  the  dntn  cited  in  Ref.  7  on  the  basis  of  *Mch 
Eq.  l4  w tin  derived.  In  the  form  of  an  equation,  the  product  rale  for 
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taultiaxis  excess  control  capacity  Is 

1  i  ■ 

'  /  N 

I  It  (^s^/^c)  > 

1  i«2  1 

X®i  < 

,  (*ecc)a  -  / 

: 

/  XflMAX  ; 

V 

X8i  "  XSMAX 
1^1,  2,  .  . 

I 

The  optimistic  estimate  of  raultiaxis  excess  control  capacity  is  less 
than  0.35  for  the  longitudinal  and  vertical  control  tasks.  This  optimis¬ 
tic  prediction  corresponds  to  t.  Cooper  Scale  Eating  of  less  than  6.  The 
pessimistic  estimate' of  multiaxis  excess  control  capacity  is  "between  0.1 

and  0.2  for  the  same  tasks.  This  pessimistic  prediction  corresponds  to  a 

« 

Cooper  Scale  Rating  betvreen  7  and  8.,  The  corresponding  subjective  rating 
of  multiaxis  controllability  and  precision  based  on  the  scale  proposed  in 
Table  IV-p  is  estimated  to  be  about  C3:  ’’Controllable,  with  less  than 
adequate  precision.”  The  corresponding  subjective  rating  of  multiaxis 

I  1 

attentional  demand  based  on  t^ie  scale  proposed  in  Table  IV-3  is  estimated 

to  be  about  DU:  "Quite  demanding.” 

.  1  '  . 

Estimates  of  excess  control  capacity  and  subjective  rating  with  the 
director  format  are  expected  to  be  more  favorable  and  less  demanding  of 
attentioh.  The  multiaxis  excess  control  capacity  is  predicted  to  be  about 
0.5  ±  0.1 ;  the  subjective  controllability,  about  C2,  ’’Easy  to  control,  with 
fair  precision”;  and  the  .subjective  attentional  demand,  about  D3,  "Mildly 
demanding.”  1 

Measurements  of  excess  control  capacity  and  subjective  rating  with  the 

I  1 

atate-and-rate  format  are  expected  to  be  between  those  for  the  state  format 
and  those  for  the  director  format.  : 

I 

D.  Multiaxis  Scanning  Behavior  1 

1 

The  general  principles  and  analytical  techniques  for  predicting  multi- 
axis  scanning  behaviqr  and  perfoimance  on  a  preliminary  control  display 
design  are  described  end  applied  in  Refs.  8  and  9.  Four  points  of  fixation 
will  bd  hypotheo 1 zed  in  the  pilot,  experiment:  two  for  the  purpose  of  control 
ond  two  for  the  purpose  of  monitoring.  The  two  fixation  points  for  control 
will  be  the  integrated  display  and  the  pair  of  vertical  scale  displays;  the 
two  point 0  for  monitoring  will  be  the  airspeed  indicator  and  altimeter. 
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The  effective  dwell  fraction  (r)e)  and  the  scanning  frequency  (c%) 
for  the  integrated  display  will  be  estimated  by  hypothesizing  three 
conditions,  viz. ,  (l)  the  look  fraction  on  the  integrated  display  will 
approach  its  limiting  value,  0.5;  (2)  the  average  scanning  frequency 
( und  look  fraction)  on  the  integrated  display  will  be  approximately  the 
name  as  that  on  the  pair  of  vertical  scale  displays  for  height  control, 
because  these  are  the  only  two  points  of  fixation  for  the  purpose  of 
control;  and,  (5)  sampling  remnant  power  for  the  integrated  display  will 
be  suppressed  to  the  same  order  of  magnitude  as  equalization  remnant 
power  for  the  longitudinal  position  (x)  display. 

The  third  hypothesis  enables  a  lower  bound  to  be  estimated  for  the 
effective  sampling-to-crossover  frequency  ratio,  S,  defined  by  Eq.  20. 

s  =  “  ne)  (2°) 

Experimental  results  in  Ref. 11  suggested  the  following  ranges  of  values 
for  S: 

4  <  S  <  6  for  separate  displays  among  which  parafoveal 
perception  is  inhibited 

6  <  S  <  10  for  combined  displays  among  which  parafoveal 
perception  may  be  significant. 

However,  recent  measurements  in  Ref.  12  suggest  that  3  >  ^5  f°r  the 
outer  (position)  loop  and  that  6  <  S  <  15  for  the  inner  (attitude)  loop 
under  simulated  instrument  flight  conditions. 

A  physical  Interpretation  of  the  ratio  S  can  be  gained  by  converting 
the  circular  frequencies  and  cog  in  Eq.  20  into  their  respective  periods, 
and  Ta ,  through  the  substitutions:  -  2n/Pc  and  -  2«/Ta.  Then 

by  using  the  definition  of  effective  dwell  interval  (T^)  from  Eq.  26 
below,  the  ratJo  S  can  be  expressed  os  the  ratio  of  the  crossover  period 
(Pc)  relative  to  the  effective  fixation  interrupt  interval  (T„  -  Tag)  or 
time-away  from  a  display >  The  ratio  3  should  be  large  to  minimize  effects 
of  scanning  remnant.  An  integrated  display  should  help  the  pilot  to  adopt 
a  large  ratio  0. 
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In  order  to  suppress  sampling  remnant  power  to  the  same  order  of 
magnitude  as  equalization  remnant  power  in  the  x-display,  the  third 
hypothesis  can  be  expressed  by  the  inequality 


1 


< 


0TS1O-T)e) 


(21) 


« 


where  and  ( 1  -T)e ) are  internal  values  for  processing  remnant  adapted 

from  Table  II-3  in  the  text.  aij  will  be  taken  as  0.1  sec  end  (l-i)e). 

s  1  * 

as  0.9  for  making  this  estimate  of  Sx.  The  value  for  ccc  ,  O.L  rad/sec, 

and  the  value  for  TLx,  3*3  sec,  are  from  Topic  A  in  this  Appendix.  The 

value  for  the  longitudinal  variance  ratio  ( au/cr^)  will  estimated  from 

the  performance  calculations  which  follow  subsequently  in  Topic  E  of  this 

Appendix.  The  longitudinal  variance  ratio  lies  in  the  range 

0.06l  <  <  0.214. 


The  lower  bound  is  the  Ug-gust-correlated  value;  the  upper  bound  is  the 
uncorrelated  variance  ratio  governed  by  remnant.  After  substituting 
numerical  values  in  Eq.  21 ,  we  obtain  a  range  for  Sx:  25.9  <  Sx  <  52.3* 
Since  this  range  exceeds  the  measured  values  for  S  obtained  to  date,  we 
shall  adopt  a  value  Sx  a  39  near  the  mid-point  for  making  predictions 
of  the  effective  dwell  fraction  and  the  scanning  frequency  on  the  inte¬ 
grated  display.  The  predictions  are  summarized  in  Table  B-VII.  There 
it  is  also  shown  that  a  value  of  Sq  ■  8  in  the  range  of  Ref.  12  for  the 

inner  (attitude)  loop  (which  is  also  presented  on  the  integrated  display), 
when  multiplied  by  the  inner  loop  crossover  frequency,  to..  ■  2  rad/aec, 
satisfies  the  equality  a>CxSx  -  ■  <%/(l-T)e)  required  by  Eq.  20  for 

the  integrated  display. 

Now  the  adopted  foveal  scanning  behavior  is  still  unknown.  It 
depends,  for  example,  on  satisfying  performance  requirements  and  the 
physical  upper  bound  on  cumulative  visual  fovea],  fixation  dwell  fraction 
(scanning  workload)  expressed  in  the  following  equation  of  constraint. 

**  '  ;  M  oeparate  displays;  with  an  optional  (22) 

scanning  workload  margin  Mg  for 
non-control  tasks 


M 

K°  +£,  11 


Til  lOj-2 
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PredicteNi  Average  Display  Scanning  Statistics  for  the  Pilot  Experioe 


This  equation  is  called  the  "scanning  workload  constraint."  It  is 
applied  in  Table  B-VTI  by  summing  the  foveal  dwell  fraction  column,  qf. 

The  sum  of  the  effective  dwell  fractions  will  exceed  unity  in  the 
scanning  workload  constraint.  This  is  called  oversaturation.  Effective 
dwell  fractions,  the  sum  of  which  apparently  exceeds  the  scanning  work¬ 
load  constraint,  can  be  achieved  with  lower  foveal  dwell  fractions  if 
parafoveal  perception  of  the  appropriately  displayed  signals  is  not 
inhibited.  A  reduced  foveal  dwell  fraction  is  estimated  in  Table  B-VII 
from  Eq.  2J>. 


8f 


Be  "  A 


(°  <  n  <  i) 


(23) 


i  -  n 

where  f 2  ■  a^/o^,  the  average  parsfoveal-to -foveal  gain  crossover 
frequency  ratio. 

A  is  largest  on  a  combined  display  with  two  signals  and  homogeneous 
equalization.  Increasing  display  separation  reduces  n  and  increasing 
the  number  of  displays  also  reduces  A.  A  predicted  parafoveal -to-foveal 
gain  ratio,  A  =>  O.63,  makes  it  possible  to  achieve  a  high  effective  dwell 
fraction,  °  0.84,  on  the  integrated  display  with  a  smaller  foveal 
dwell  fraction,  qj-  «  0  57*  listed  in  Table  B-VII. 

Predictions  for  the  two  monitored  displays,  airspeed  and  altitude, 
in  Table  B-VII  are  based  on  two  different  hypotheses,  viz,  (l)  a  foveal 
dwell  fraction  (t]f)  of  P.03  for  each;  and  a  foveal  dwell  interval, 

=■  0.4  sec  for  each. 

Predictions  for  the  pair  of  vertical  scale  displays,  h,  fi,  are  based 

on  the  remaining  foveal  dwell  fraction  (t]e  -  O.37)  required  to  occupy 

fully  the  pilot's  time  with  less  weight  given  to  parafoveal  perception. 

3ince  A  «  0.22  by  hypothesis,  a  lower  value  of  the  sampling-to-crossover 

frequency  ratio,  3^17,  i*J  assumed  for  the  height  display-control  task. 

The  average  scanning  frequency,  (fB),  scanning  interval  (Ts),  and 

effective  dwell  interval  (T,i  )  follow  from  their  definitions. 

6 


fs 

■  u^/2n  (Hz) 

(210 

Ta 

-  l/fs  (sec) 

(2?) 

% 

■  qeTQ  (sec) 

(26) 
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The  predicted  probabilities  of  fixation  are  identical  to  the  foveal 
dwell  fractions  whose  sum  is  unity  in  the  central  column  of  Table  B-VII. 
The  sum  of  the  dwell  fractions  is  unity  because  all  of  the  pilot-subjects' 
time  will  be  occupied  by  the  controlling  and  monitoring  tasks. 

Likewise  the  sum.  of  look  fractions  in  the  extreme  right  column  of 
Table  B-VII  is  unity,  because  all  of  the  pilot-subjects'  fixations  are 
predicted  to  be  on  the  experimental  displays.  The  look  fraction  on  the 
Integrated  display,  0.42  is  estimated  to  approach  its  limiting  value, 
one-half.  The  greatest  proportion  of  fixation  transitions  will  be 
between  the  integrated  display  and  the  pair  of  vertical  scale  displays. 
The  transition  "link  value"  for  these  two  displays  can  be  estimated  as 
0.79  from  the  predicted  probabilities  of  fixation  by  the  following 
relationship  from  Ref.  13* 

!2l2i  .  g(0.57)(0.37)  .  0-79  (27) 

1-£p*  1-0.464 

Other  leaser  link  values  between  the  control  displays  and  the  monitored 
displays  can  be  estimated  in  analogous  fashion  as  shown  in  Fig.  B-6. 


Fig.  d-6.  Predicted  Link  Values  for  the  Multiaxis  Experiment. 


E,  Multiaxis  Performance 

(  p  I 

The  total  error  variance  vector  f  '  i  is  related  to  the  coherent 
i  2i 

variance  vector  je  ^  j  by  the  equation 


[^8  3 


"2!  IT 

e  i  o  )e 


(28) 


where  [Ag]  is  a  square  coherence  matrix  contain.  %  elements  of  the  form 


'u 


.  2^2  i  +  ,g  jt 


do> 


(1  + 


(29) 


with  i  states  in  the  variance  vector  and  j  displayed  variables  and 


_l’i  i 


j( 


1J  |0;  i  /  JJ 


is  the  Kronecker  delta. 


Equation  28  incorporates  from  Table 31-3  in  the  text  that  portion  of 
processing  remnant  power  spectral  density  which  is  identified  with  the 
lead  equalization  time  constant  TL  and  which  is  expected  to  predominate 
over  other  types  of  remnant  in  the  raultiaxis  task  with  the  integrated 
display.  The  determinant  of  [Ag]  ■  ^  is  called  the  characteristic 
determinant  of  stability  in  the  mean-square  sense;  or  the  coherence 
determinant.  Each  component  of  the  coherent  variance  vector  has  the  form 


i/w 


♦  da) 

j  j 


(ro) 


where  iK  =  xc,  ug,  wg,  for  example,  for  N  =  5  independent  longitudinal 
inputo  such  as  separation  measurement  noise,  and  longitudinal  and  normal 
gust  velocities.  Thus  the  vector  j  €2)will,  in  general,  be  a  column 
matrix  of  linear  combinations  of  input -correlated  mean-squared  errors. 
The  formal  result  for  the  total  variance  vector  is 


IT  ~^r~M 


(3') 


The  coherence  determinant  governs  multiloop  stability  in  the  mean- 
square  sense;  therefore,  it  must  be  greater  than  zero.  A  value  for  the 
determinant  which  is  much  less  than  unity  means  that  incoherent  error 
power  due  to  processing  remnant  will  be  much  greater  thanihe  coherent 
error  power  due  to  inputs  and  disturbances.  If  the  coherence  determinant 
approaches  unity  (its  upper  bound),  the  error  power  will  become  increasingly 
coherent. 

We  shall  illustrate  the  estimation  of  the  coherent  variance  vector, 

je2|,  for  two  forms  of  a  longitudinal  (Ug)  gust  velocity  Input,  viz.,  0) 

a  random  input  having  a  continuous  power  spectrum  and  (2)  a  quasi-random 

sum-of-sine  waves'.  Both  spectra  will  have  the  same  root-mean-square  (rms) 

gust  velocity,  au  =  5.1  ft/sec.  The  required  open-loop  transfer  functions 

8 

and  closed-loop  roots,  power  spectra,  signal  variances  and  r roc  values  are 

listed  in  Table  B-VIII.  Bode  diagrams  of  the  required  open-loop  transfer 

functions  ore  illustrated  in  Fig.  B-7  for  typical  values  of  the  pilot's 

pitch  attitude  and  longitudinal  separation  loop  gains  selected  from 

Topic  A  in  the  Appendix.  Ratios  of  the  correlated  rate-to-displacement 

2/2  2/2 

signal  variance  ratios,  o  /o  ,  and  o  /o',  can  be  estimated  from  the 
°  '  u  x  q  0 

variances  at  the  end  of  Table  B-VIII .  The  coherent  variance  vector  for 
this  example  with  the  Indicated  Ug-sum-of-sine  waves  input  is 


m 

2 

\ 

* 

3.26  ft2 

0t 

0.341E-0U  rad2 

NJ 

0.41 7E-0U  rad2 

(52) 


'Tbvioun ly,  the  manually-controlled  separation-keeping  task  is  not 
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Figure  D-7'a).  Open-Loop  Bode  Diagram  for 
a  Manually  Controlled  Inner  Loop 
with  Kq  a  -0.02 


Figure  0-7(b).  Open-I,oop  Bode  Diagram  for 
a  Ma  ually  Controlled  Outer  Loop  with 
K*  0.00317  Bart/Ft;  Tl  -  3.33  See 


TABLE  B-VIII 


Open-Loop  Transfer  Functions  and  Closed-Loop  Roots,  Spectra  and  Variances 
for  Manually  Controlled  Inner  Pitch  Attitude  and  Outer  Longitudinal 
Separation  Loops  with  a  State  Display  and  Longitudinal  Gust  Disturbances 


inner  loop  s  —  with  =  -0.2 

TRANS.  FUNC.  ON  u,,’  it  F  'I  [ 
NUMERATOR 


.91000E  n 


High  Frequency  Gain 

I - Pade1  Zeros  ■ 


1 


(  . 157  03E-  1);  ..OOOOE  1K-.12121E  2X-.12121E  2) 

(-  Zw)  (-4/T9)  (-4/T9) 


DENOMINATOR 


.lOOOnE 


High  Frequency  Gain 

Pade ’  Poles 


'•  .42999E-  1)(  .  1 0000E  1M  .’2121c  2)(  .12:21?  2. 

(1/Tpi)  (-Zy)  (4/T0)  (4/t01 

•  62799E  0  . 18918E  1 

N.S.  RREG  GAIN  MARGIN 
RAD/SEC  DB 

2.941  lc . 575 

NO  WC 

CLOSED  LOOP  ROOTS  (NUM+DENOM) 

.  lOHODE  1 

(  . 373 OOF  -  1) (  • 1  0000E  1) 

.48277P  •  .  20614E  1 

.98f 51i  0  •  12485E  2 

OUTER  LOOP  u — +  with  K^,  »  0..00317  rad/ft  with  inner  loop  closed 

~r’’ANS.  FUNC.  ON  OU V I  1 T  FILE 
'E1'  r4”,:‘  High  Frequency  Gain 


.17.i4  k  l 

(  .30n3r  0)(  .  1 0O00E  1X-.12121E  2X-.12121E  2) 

(1/%)  (-Zy)  (-4/T0)  (-4/T0) 

.383  1  .2 131  IE  1 

C  <» 

DENOMINATOR  (from  closed-loop  roots  for  inner  loop  above) 
. IOOOoE  1 

(  .OOOOOE  0)(  .37300E-  IX  .100"OE  1 ) (  .50000E  1) 


.40277E  0  .20614E 

•9flft51E  0  » ] 2485E 


1 

2 


TABLE  B-VIII 

Open-Loop  Transfer  Functions  and  Closed -Loop  Roots,  Spectra  and  Variances 
for  Manually  Controlled  Inner  Pitch  Attitude  and  Outer  Longitudinal 
Separation  Loops  with  a  State  Display  and  Longitudinal  Gust  Disturbances 

( Continued}1 


.S.  FREQ 

GAIN  MARGIN 

RAD/SEC 

DB 

1 .285 

14.093 

2.103 

38.197 

4.211 

26.193 

wc 

PHASE  MARGIN 

RAD/SEC 

DEG 

.414 

36.263 

CLOSED  LOOP  ROOTS  (NUM+DENOM) 


.  1 0  000E  1 


(  . 10000E 

1)(  .25857E 

1) 

.47914E 

0  . 39387E 

0 

. 65033E 

0  .216o9E 

1 

•  96085E 

0  . 1 3467E 

2 

UG-SUM  OF  SINE  WAVES 

INPUT  RMS- 

.5100E  1 

X  /UG 

TRANS.  1 

-UNC 

• 

FREO 

MAGNITUDE 

PHASE 

REAL 

IMAGINARY 

.19 

-7.98 

-36.56 

*  32  07E 

0  -®2378E 

0 

.50 

-12.13 

- 

133.05 

-. 1688E 

0  1800E 

0 

1.26 

-32.34 

- 

197.63 

-.2301E- 

i  .7313E-  2 

3.02 

-50.80 

- 

157.39 

-. 2662E- 

2  -. 1108E-  2 

6.28 

-61.14 

- 

170.31 

- .8647E- 

3  -  * ) 476E-  3 

VARIANCE 

RMS 

X 

(FT) 

. 325°9E 

1 

•  18055E 

1 

U 

( pT/SEC ) 

•20065E 

0 

•44794E 

0 

THETA  (RAO) 

.34122E- 

4 

•58414E- 

2 

a 

(RAO /SEC) 

.B3B98E- 

5 

•23965E- 

2 

OB 

(IN) 

.41678E- 

4 

.64589E- 

2 
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TABLE  B-VTII 

Open-Loop  Transfer  Functions  and  Closed-Loop  Roots,  Spectra  and  Variances 
for  Manually  Controlled  Inner  Pitch  Attitude  and  Outer  Longitudinal 
Separation  Loops  with  a  State  Display  and  Longitudinal  Oust  Distrubancea 

(  Concluded  ) 


UG  RANDOM  INPUT  RMS=  .510  E 
C.L.  SPECTRA  ON  OUTPUT  FIlE 
DENOMINATOR 


1/TCR=  .3142E  0 


/ 


Half -Power  Frequency  (rad/sec)  of  first 


Order  Spectrum. 


.logons  ) 

(  .M417E  d)<  .10000E  1)(  .25857E  i) 


.47914E  0  . 39387E  0 

.GSO.^E  0  .21669E  1 

. 96085E  0  » 13467E  2 

X  NUMEP  TOR 


.8439  Jr-  1 

(  .10000 E  1)(  • 50000E 

.229  -0E  0  .21085E  1 

.994  o9E  0  . 12256E  2 

THETA  NUMERATOR 

-.88'  -  2 

(  .  1 8  j.  4 4 £  0  H  -  ♦  37324E 

.98956E  j  .74838E  1 

OB  NUMERATOR 
- . 58227E-  2 

(  •  34365E  OH  .  10000E 


1) 


0)(  • 10000E  1)(  • 14623E  2) 


1 )  (-• 12121F  2 ) ( -• 12121E  2) 


.57] 7QE  0  . 16674F  1 


UG  RANDOM  INPUT  RMS=  .5100E  1  1 /TCR=  .3142E  0 


X  (FT) 

U  (FT/SEC) 
THETA  (RAO) 

O  (RAO/SEC) 
08  (PAD) 


VARIANCE 
. 25175E  1 

. 16S19E  0 

.  32779E-  4 
. 14765E-  4 
• 33647E-  4 


RMS 

. 15887E  ] 

•  4  064 4 E  0 
.572531.-  2 
.3U425E-  2 
.580O8E-  2 
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upset  significantly  by  the  longitudinal  gust  rraa  velocity  of  5*1  ft/sec. 

Wo  shall  illustrate  the  estimation  of  the  total  variance  vector, 
je2j,  for  the  same  longitudinal  gust  rraa  velocity  of  5.1  ft/sec  with 
three  sources  of  processing  remnant  nx,  n q,  n^,  depicted  in  Pig.  B-1 
or  page  B->2.  The  injected  remnant  nv  will  include  the  contribution  from 
which  is  appropriate  for  the  state  display  format  wherein  the  pilot 
must  supply  lead  equalization  in  the  outer-loop.  Table  B-IX  presents 
estimated  closed-loop  spectra  and  variances  for  each  source  of  processing 
remnant  having  a  unit  rms  value  and  first  order  input  noise  spectrum  with 
the  indicated  half  power  frequency,  1  /T^  «  l/TCR.  The  results  in  Table  B-IX 
provide  the  values  Tor  the  nine  integrals  required  in  Eq.  29  to 
estimate  the  elements  of  the  3x3  coherence  matrix: 


0.741 
-1 .91E-05 
-3.83E-05 


-33*2 

0.998? 

-4.28E-03 


-33.27 

-3.02E-03 

O.980 


(33) 


The  coherence  determinant  |Aq|  ■  Ag  »  0.732,  therefore,  we  expect  that 
at  least  the  outer-loop  error  power  will  be  primarily  coherent,  i.e. , 


due  to  the  gust  disturbance. 

The  coherent  variance  vector  for 

8 


5.1  ft/sec  in  Table  B-VIII  is 


[3.26  ft2 

0.341E-04  rad2 
0.417E-O4  rnd2 


(34) 


After  the  operations  required  by  Eq.  31  are  performed,  the  resulting  total 


variance  vector  is 


—  — 

m 

~2 

X 

n 

4.4o  ft,2 

1 .19E-04 

rad2 

fed 

2. 14E-04 

rad2 

The  coherence  vector  then  becomes 


m 

r  2" 

px 

n 

0.74 

2 

P0 

0.206 

2 

w 

0.19? 

(35) 


(tf) 
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TABLE  B-IX 


Closed-Loop  Spectra  and  Variances  for  Manually  Controlled . Inner 
Pitch  Attitude  and  Outer  Longitudinal  Separation 
Loops  with  a  State  Display  and  Remnant  Disturbances 


NOB  RANDOM  INPUT  RMS=  . 1000E  1  1/TCR=  . 1000E  2 


C.L.  SPECTRA  ON  OUTPUT  FTLE 
DENOM’  .ATOP 

.inonnE  1  , 

(  . lOnoOE  1)(  .25857E  1) (  .10D00E  2) 

.47914E  0  . 39387E  0  1 

.65033E  0  . 21669E  1 

.  96085E  0  . 13467E  2 

1 

X  NUMERATOR  ,  , 

.81497F  2 

(  «  1 0  0  0  0  E  1)(  .50000E  1) 

•  3R325E-  1  .21 31  IE  1 
.  lODfiOE  1  . 12 1 2 IE  2 

THET/,  NUMERATOR 

-.i  -flO  2 
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(  .12121c  2) 

DB  NUMERATOR 


.28231 F  1 

(  .nonong;  0)(  .42999E-  1)(  .l.'i'OOE  1)(  .50n0nE  l) 


.82799E  0  .18918E  1 

. loonoe  1  • 1212  IE  2 

NOB  RANDOM  INPUT  RMS=  .1000E  1  1/TCR=  . 1000E  2 


X  (FT) 

U  (FT/SEC) 
THETA  (RAO) 

0  (RAD/SEC) 
08  (RAD) 


VARIANCE 
.  3827  IE  4 
.44597E  3 

.3D184E  0 

.87526E  0 

. 10700E  1 


RMS 

.81803E  2 

.211  m:  2 

.i 

.<'3 •  .1 

•  1  03(/i  1 
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TABLE  B-IX 

Closedi-Loop  Spectre  and  Variances  for  Manually  Controlled  Inner 
Pitch  Attitude  and1  Outer  Longitudinal  Separation 
Loops  with  a  State  Display  and  Remnant  Disturbances 

(Continued) 


i 

NTHETA  RANDOM  INPUT  'rMS=  .lOORE  1  l'/TCR=  '.4000E  1 

C.L.  SPECTRA  ON  OUTPUT  FILE 


DENOMINATOR 
.isonoE  1 
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I 
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'  l 
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,  I 

VARIANCE  RMS 
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TABLE  B-IX 


Closed-Loop  Spectra  and  Variances  for  Manually  Controlled  Inner 
Pitch  Atticude  and  Outer  Longitudinal  Separation 
Loops  with  a  State  Display  and  Remnant  Disturbances 

( Concluded) 


NX  RANDOM  INPUT  RMS=  . 1000E  1  1 /TCR=  .3003E  0 

C.L.  SPECTRA  ON  OUTPUT  FILE 


DENOMINATOR 
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X  (FT! 
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VARIANCE 
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RMS 
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•97214E-  2 
. 15353E-  1 
• \ 3799E-  1 
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The  predicted  gust-correlated  and  total  rraa  values  of  the  five  variables 
listed  in  Table  B-VIII  are  summarized  below  for  &y  =  5«1  ft/sec  and  including 

O 

contributions  from  processing  remnant  as  described  above. 


Gust-Correlated 
rms  Value 

for  cr„  e  5.1  ft/sec 


u, 


g 


Total  rms  Value  Relative  Coherence 

with  Processing  2 

Remnant  p 


X  (ft) 

. 1 8O55E  1 

.210  E  1 

0.74 

u  (ft/sec) 

. 4479UE  0 

.970  E  0 

0.21 

0  (rad) 

.5041 4E-  2 

1 .090  E-  2 

0.29 

q  (rad/sec) 

.28965E-  2 

3.520  E-  2 

0.007 

(in) 

.64559E-  2 

1 .460  E-  2 

0.2 
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APPENDIX  C 


DERIVATION  OP  RATING  SCALES  FOR 
DISPLAY  EVALUATION 

by  Henry  R.  Jex 

The  purpose  of  this  appendix  is  to  derive  an  appropriate  set  of  rating 
scales  for  subjective  evaluation  of  the  control  task  difficulty  and  the 
attentional  demands  of  the  display  in  simulation  programs  involving  display/ 
pilot/vehicle  interactions. 

A.  BACKGROUND  AND  RATIONALE 

The  technical  approach  employed  here  derives  from  the  well  established 
art  of  aircraft  handling  qualities  assessment;  pioneered  by  Cooper  (Ref.  1 ), 
refined  by  Harper  (Ref.  2),  put  on  a  rational  basis  by  Ashkenas  (Ref.  3), 
and  connected  to  the  equally  complex  art  of  psychophysical  scaling  by 
McDonnell  (Ref.  4). 

Our  rationale  for  selecting  the  scales  and  scheme  was  based  on  the 
following  criteria: 

1 .  It  is  necessary  to  separate  out  the  difficulty  of  the 
task  (situation,  criteria,  forcing  functions,  control 
and  vehicle  dynamics)  from  the  attentional  workload  of 
the  display,  per  se  (related  to  its  perceptual  properties, 
dynamics,  viewing  conditions,  etc.). 

2.  The  problem  is  less  "global"  (more  specialized)  than 
overall  handling- qualities  ratings,  and  the  Rcaleo 
should  reflect  these  constraints. 

3.  It  is  desirable  to  have  a  scale  known  to  be  of  "interval" 
typo,  to  permit  simple  arithmetic  averaging  and  classical 
statistical  analyses. 

The  first  two  criteria  result  from  the  realization  that,  whereas  overall 
handling  qualities  evaluations  lump  all  of  the  system  characteristics 
under  one  evaluation,  display  quality  evaluations  must  be  able  to  isolate 
display  defects  from  (say)  controlled-element  defocto.  Consequently,  r.n 
independent  subjective  evaluation  of  the  latter  is  required.  For  the 
majority  of  foreseeable  situations,  the  primary  task-related  traits  will 

(M 


TV  1  IV, 


be  the  controllability  and  adequacy  of  precision"  obtainable  under  the 
ideal  display  conditions,  as  well  as  the  "attentional  workload"  of  the 
display  itself. 

The  third  criterion  (inte* val-type  scales)  is  based  on  practical 
considerations.  "Ranking"  scales  require  nonparametrie  statistical 
analyses,  which  are  less  w all  developed  and  less  available  as  computer 
subroutines  than  classical  parametric  statistical  methods  (e.g., 
analysis  of  variance,  linear  regression  analysis,  etc.).  Interval-type 
scales  permit  all  these  efficient  subroutines  to  be  used.  Ratio-type 
subjective  scales  have  been  evolved  and  used  successfully,  notably  by 
Vercace  (Ref.  5)  and  Nordstrom  (Ref.  6).  However,  ratio-type  scales 
are  needlessly  complex  for  the  intended  experiments,  because  each 
evaluation  requires  return  to  the  reference  configuration.  In  our 
experiments,  which  would  involve  resetting  a  large  number  of  parameters 
for  each  data  point,  this  technique  would  consume  too  much  time. 

The  research  in  Ref.  4  showed  that  an  interval- type  semantic  scaling 
of  specific  evaluation  phrases  could  be  derived  via  the  "Method  of 
Successive  Intervals,"  basing  these  intervals  on  the  "discrininal 
dispersion,"  (standard  deviation  of  subjective  numerical  ratings 
for  a  given  phrase  among  a  large  population  of  pilots ) .  The  resulting 
semantic  scale  is  called  a  "ty-scale"  and  has  the  properties  of  an  interval- 
type  scale  with  roughly  homogeneous  rating  variances  (o^)  across  the  scale. 
In  light  of  the  foregoing  considerations,  the  display  rating  scales  were 
based  on  the  pkrases  and  \|/-scale  data  in  Ref.  4. 

B.  SELECTION  OF  THE  SCALES 

The  array  of  64  handling  qualities  evaluation  phrases  in  Ref.  4  included 
gradations  within  several  "trait"  groups,  such  as:  overall  handling 
qualities,  controllability  and  precision,  vehicle  response  characteristics, 
demands  on  the  pilot,  etc.  Most  of  the  vehicle-specific  trait  groups  are 
not  of  interest  here,  but  the  (task)  Controllability  and  Precision  and 
Demands  on  Pilot  groups  are  directly  applicable  to  display  rating. 

W] ih In  each  group  a  selection  of  five  phrases  was  made,  according  to  the 
following  criteria: 
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1 .  Roughly  uniform  intervals  across  the  total  range  of 
t  from  1  to  10. 

2.  Roughly  equal  discriminal  dispersions, 

3-  Context  relevant  to  the  display  task  situation. 

4.  Simple  terms  with  consistent  adjectives. 

Five  evaluation  levels  are  considered  quite  adequate  for  the  simple 
traits  being  rated  (9  or  10  are  required  for  global  handling  qualities 
to  provide  more  contextual  degrees  of  freedom) .  The  selected  phrases 
are  shown  in  Table  C-I,  arranged  in  their  semantic  relationship  (y)  as 
determined  from  Table  B-I  (Col.  9)  of  Ref.  4.  Also  shown  in  Table  C-I 
are  the  corresponding  discriminal  dispersions,  c. .  It  is  clearly 
apparent  that  the  goals  of  uniform  coverage  and  variance  are  met. 
Furthermore,  there  is  an  approximately  2 separation  between  phrases, 
implying  clear  semantic  distinctions. 

The  five  levels  in  each  category  are  given  rating  scale  numbers  from 
1  to  5  from  best-to-worst,  in  line  with  established  handling  qualities 
rating  practice.  Task  Controllability  and  precision  ratings  are  coded 
as  Cl  -C5,  while  Display  attentional  demand  ratings  are  coded  as  D1  -D5, 
as  shown  in  Table  IV-3  in  the  text . 

C.  UBE  07  SCALES 

For  proper  evaluation  of  a  display,  it  should  be  tested  in  the  context 
of  the  intended  operational  situation.  Practicably  speaking,  this  means 
specifying  a  realistic  '’scenario"  for  the  simulation  and  using  similar 
mission  criteria,  coraaands,  disturbances  and  controlled  elements.  All 
subjects  must  be  told  the  same  scenario  and  criteria. 

Both  the  taak  controllability  and  display  workload  must  be  rated,  to 
be  able  to  separate  out  the  demands  due  to  controllability  (of  task  and 
vehicle  origin)  from  those  of  the  display  Itself.  A  specific  fomila. 
for  this  separation  is  not  yet  available  and  will  be  one  object  of  pending 
experiments. 

To  guide  the  controllability  and  precision  rating,  a  three-stage 
dcclnion  process  has  been  indicated  in  Table  IV- 3  in  the  taxi: 
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TABLE  C-I 


SEMANTIC  RELATIONSHIP  OF  DISPLAY  RATING  PHRASES 


DEMANDS  ON  PILOT 

SEMANTIC  "...of  pilot  attention, 

SCALE  skill,  or  effort." 


CONTROLLABILITY 

SEMANTIC  . . .and  precision  of 

SCALE  control 

♦ 


Very  easy  to  control, 
with  good  precision 


Easy  to  control,  with 
fair  precision 


Controllable,  with... 
inadequate  precision 


Marginally  controllable 


Uncontrollable 


Notes:  (Data  are  from  AFFDL-TR-68-76;  Ref.  4) 

1.  ^  denotes  semantic  scale  obtained  by  method  of  Successive  Intervals. 

?.  J  denotes  the  "oemontic  diacriminal  dispersion"  (standard  deviation 
of  \i>  scores). 

5.  OdonofcG°  c°d®  number  of  phrase  in  Ref.  4. 


1.  "Is  it  controllable? "  Separates  C1-C4  from  C5. 

2.  "1'3  the  control  precise  enough  for  the  mission 
criteria?"  Separates  C1-C2  from  C3-C4. 

3.  "What  remaining  phrase  best  describes  the  evalu¬ 
ation?"  Selects  the  specific  phrase  and  rating. 

A  corresponding  decision  tree  is  not  useful  for  the  display  workload 
rating,  because  the  5  levels  are  simply  gradations  along  the  continuum 
of  demands  on  the  operator1 s  attention,  skill  or  effort  in  using  the 
display  for  the  task  at  hand. 

In  use,  experience  has  shown  that  at  least  two  replications  per 
configuration  should  be  made  with  two  or  more  experienced  operators 
to  provide  a  measure  of  intrinsic  variance  and  remove  learning  and 
chance  artifacts.  A  typical  comparison  between  objective  (performance) 
measures  and  subjective  display  rankings  among  four  pilots  is  given  in 
Ref.  7. 


CONCLUSIONS 

A  pair  of  simple  rating  scales  for  use  in  research  on  manual  control 
displays  has  been  derived  (Table  IV-3),  based  on  the  extensive  foundation 
provided  in  Ref.  4.  These  scales  are  of  interval-scale  quality  and  will 
permit  averaging  and  other  standard  parametric  statistics!  analyses. 

Use  of  two  trait  categories:  "task  controllability-and-precision"  and 
"display  attentionol  workload,"  should  permit  separation  of  these  often- 
confounded  effects. 

It  is  recommended  that  these  rating  scales  be  used  in  all  display- 
related  simulations  to  provide  the  data  base  needed  to  refine  them  and 
to  provide  a  formula  for  separating  the  controllability  and  display 
workload  factors. 


C-5 


Tn-in>? 


APPENDIX  C 
RE7XRENCXS 


1.  Cooper,  G*  E.,  "Understanding  and  Interpreting  Pilot  Opinion,"  Aeron. 
Eng.  Rev. ,  Vol.  16,  No.  3,  Mar.  1957,  pp.  *47-52. 

2-  Harper,  R.  P.,  Jr.,  and  George  E.  Cooper,  A  Revised  Pilot  Rating  Scale 
for  the  Evaluation  of  Handling  Qualities,  Cornell  Aero  Labs. 

Rept.  153,  Sept.  1966. 

3.  Ashkenas,  I.  L-,  and  D.  T.  McRuer,  "A  Theory  of  Handling  Qualities 

Derived  frctn  Pilot-Vehicle  System  Considerations,"  Aero.  Eng., 

Vol.  21,  No.  2,  Feb.  1962,  pp.  60,  6l ,  83-102. 

4.  McDonnell,  John  D.,  Pilot  Rating  Techniques  for  the  Estimation  and 

Evaluation  of  Handling  Qualifies,  AFFDL-TR- 68-76,  Dec.  1966. 

5.  Veroace,  J.,  Measurement  of  Ride  Comfort,  SAE  Paper  638A,  Jan.  1963* 

6-  Nordstrom,  Lennart,  and  Hakan  Arne,  "A  Simulator  Comparison  Between 

Two  Methods  of  Computing  and  Displaying  the  Velocity  in  a  Head-Up 
Display  for  Low  Speed  Flight  Path  Control,"  ICAS  Paper  No.  66-1 6, 
Sept.  1966. 

7.  Allen,  R.  W.,  and  H.  R.  Jex,  An  Experimental  Investigation  of  Compen¬ 
satory  and  Pursuit  Tracking  Displays  with  Rate  and  Accelerating 
Control  Dynamics  and  a  disturbance  Input,  NASA  CR-1092,  June  1968. 


TR-IB3 


C-6 


